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Abstract  of  Dissertation  Presented  to  the  Graduate  School 
of  the  University  of  Florida  in  Partial  Fulfillment  of  the 
Requirements  for  the  Degree  of  Doctor  of  Philosophy 

ESSAYS  ON  THE  PERSONAL  RESPONSIBILITY  AND  WORK  OPPORTUNITY 
RECONCILIATION  ACT  AND  DISABLED  CHILDREN 

By 

Caprice  Garing  Knapp 
May  2003 

Chair:  David  Figlio 

Major  Department:  Economics 

The  three  essays  in  this  dissertation  examine  the  1 996  Personal  Responsibility  and 
Work  Opportunity  Reconciliation  Act  and  its  effect  on  disabled  children.  Each  chapter 
uses  data  from  the  state  of  Florida  to  estimate  various  effects.  Chapter  2  investigates  the 
effect  that  the  policy  had  on  the  classification  rate  of  children  as  disabled.  Financial 
incentives  existed  for  both  parents  and  schools  to  classify  children  as  disabled.  One 
implication  of  the  1996  act  was  that  this  mix  of  incentives  changed.  While  school 
incentives  to  classify  remained,  the  incentives  for  parents  were  reduced.  Using  data  from 
twenty-one  districts,  and  a  variety  of  econometric  techniques,  I  show  that  reducing  these 
parental  incentives  led  to  a  decrease  in  overall  disability  classification.  Following  the 
policy,  classification  of  children  as  disabled  fell  in  the  range  of  1 1  to  19%. 

Chapter  3  uses  similar  methods  to  accomplish  two  objectives.  First,  I  use  a  much 
larger  and  more  complete  data  set  to  corroborate  the  results  found  in  the  previous  chapter. 

xi 


Using  data  from  all  sixty-seven  districts  and  similar  econometric  techniques,  I  find  that 
following  the  policy;  classification  was  reduced  in  a  range  of  6.4  to  8.2%.  Second,  I 
examine  the  question  of  whether  the  inclusion  of  birth  vital  statistics  is  imperative  to  the 
results.  Including  these  statistics  in  the  analysis  indicates  that  the  primary  results  are 
unchanged. 

Chapter  4  measures  the  welfare  effects  of  the  policy  on  outcomes  of  disabled 
children.  Data  from  two  large  school  districts  were  used  that  included  both 
administrative  and  standardized  test  score  information.  Two  methodologies  were  used  to 
capture  the  effects  of  the  policy  on  math  and  reading  scores.  Both  methodologies  found 
that  children  who  were  directly  affected  by  the  policy  realized  significant  welfare  gains. 
Math  scores  for  this  group  of  children  increased  by  2.91  points  after  the  policy  with 
similar  results  for  reading  scores.  Equating  this  to  classroom  time,  I  find  that  the  increase 
in  math  scores  was  equivalent  to  36  days  of  additional  instruction.  These  results  suggest 
that  at  least  in  one  of  its  objectives,  welfare  reform  was  successful.  I  find  support  for  the 
idea  that  misclassification  was  occurring  prior  to  the  policy  change.  Furthermore,  the 
policy  change  provided  less  perverse  financial  incentives  for  parents. 
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CHAPTER  1 
INTRODUCTION 

The  1990s  were  a  decade  of  economic  prosperity,  peace  and  change.  During 
President  Clinton's  two  terms  as  President  of  the  United  States,  many  monumental 
legislative  changes  were  made.  Unquestionably,  one  of  the  most  important  pieces  of 
legislation  was  signed  in  August  1996.  The  104th  Congress  with  a  great  amount  of 
bipartisan  support  passed  the  Personal  Responsibility  and  Work  Opportunity 
Reconciliation  Act  (PRWORA).  Primarily,  the  legislation  ended  over  sixty  years  of  the 
Aid  to  Families  With  Dependent  Children  (AFDC)  program.  Prior  to  1 996,  many 
politicians  and  citizens  had  strongly  opposed  AFDC  due  to  the  perverse  incentives  they 
believed  were  built  into  the  system.  Therefore,  when  PRWORA,  or  welfare  reform  as  it 
is  commonly  know,  was  enacted,  it  focused  on  abolishing  AFDC  and  promoting  stable 
families.  The  major  aspects  of  welfare  reform  were  as  follows: 

•  It  replaced  AFDC  with  the  new  Temporary  Assistance  for  Needy  Families  (TANF) 
program.  This  new  cash  assistance  system  allowed  states  to  develop  their  own 
welfare  reform  programs,  granted  that  they  meet  federal  guidelines. 

•  Time  limits  and  strict  work  requirements  were  imposed  on  individuals  receiving 
TANF  funds.  Federal  guidelines  restricted  the  receipt  of  cash  assistance  for  60 
months  over  the  span  of  an  individual's  life.  Further,  at  least  50%  of  all  families 
receiving  TANF  were  required  to  be  working  or  enrolled  in  programs  that  would 
prepare  them  for  the  workforce. 

Many  economic  studies  have  been  conducted  to  evaluate  the  merits  of  welfare 
reform.1  From  these  studies,  a  consensus  of  PRWORA's  record  emerges.  Prior  to  2000, 
PRWORA  resulted  in  a  significant  decrease  in  caseloads  and  an  increase  in  labor  force 

1  See  Blank  2002  for  an  excellent  review. 
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participation  among  low-income  families  and  single  mothers.  And  while  these  results  are 
encouraging,  two  major  issues  must  be  addressed.  First,  it  is  unclear  how  much  of  the 
success  of  welfare  reform  is  due  in  part  to  the  reforms  themselves,  or  the  prosperous 
economy  of  the  late  1990s.  The  scope  of  this  issue  is  beyond  this  dissertation,  but 
nonetheless  important.  Second,  there  were  numerous  programs,  other  than  TANF,  that 
were  affected  by  PRWORA,  and  those  have  received  little  attention  by  researchers. 
Some  of  the  other,  but  still  very  important,  aspects  of  welfare  reform  were  as  follows: 

•  Restriction  of  immigrant  families  for  many  services  and  benefits,  such  as  food 
stamps  and  Medicaid. 

•  Increased  funding  for  government  provided  childcare.  As  many  single  mothers 
returned  to  work  post- 1996,  the  government  devoted  sizable  grants  towards  child 
care  provisions  through  the  Child  Care  and  Development  Fund. 

•  A  strong  emphasis  on  states  to  enact  programs  that  would  create  more  stable 
families.  Examples  of  these  programs  goals  were  to  decrease  teen  pregnancy  rates, 
increase  marriage  rates  and  increase  enforcement  of  child  support  laws. 

•  The  structural  change  of  two  major  child  welfare  agencies:  Child  Welfare  Services 
and  Foster  Care  Maintenance. 

•  Modification  of  disability  definition,  and  stricter  guidelines  for  children  receiving 
Supplemental  Security  Income  (SSI). 

Surprisingly,  the  majority  of  welfare  reform  economic  research  has  focused  on 
behaviors  of  the  current  generation  of  low-income  adults.  This  research,  which  primarily 
focuses  on  caseloads  and  labor  force  participation,  is  important,  but  is  limited.  Since  one 
motivation  behind  welfare  reform  was  to  decrease  the  intergenerational  affects  of 
poverty,  research  that  focuses  on  PRWORA's  effects  on  low-income  children  is  needed. 
This  dissertation  focuses  on  those  intergenerational  effects  through  the  changes  that 
PRWORA  made  to  the  SSI  program  for  disabled  children. 
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Why  should  the  effects  of  PRWORA  on  disabled  children  be  considered?  In  1999, 

the  disabled  student  population  in  the  public  school  system  of  the  United  States  was 

5,683,707  students  (Office  of  Special  Education  Programs  2000).  This  group  of  children 

represents  approximately  12%  of  the  entire  student  population,  and  their  numbers 

continue  to  grow  every  year.  Not  only  do  the  sheer  numbers  of  children  that  are  affected 

make  this  an  important  area  of  research,  but  also  the  financing  implications  are 

staggering.  On  average,  disabled  students  bring  in  one-fifth  of  each  school's  budget 

expenditures.  With  such  substantial  expenses  involved,  and  with  the  growing  number  of 

children  being  affected,  this  area  of  welfare  reform  is  ripe  for  research.  This  dissertation 

estimates  the  intergenerational  effects  that  welfare  reform  had  on  disabled  children. 

1.1  Anti-Poverty  Programs,  Parental  Incentives,  and  the  Classification  of  Disabled 

Children 

Chapter  2  of  this  dissertation  investigates  whether  PRWORA  caused 
intergenerational  effects  on  disabled  children,  and  what  the  magnitude  of  those  effects 
was.  One  aspect  of  PRWORA  was  the  changes  made  to  the  SSI  program  for  disabled 
children.  Prior  to  PRWORA,  children  qualified  to  receive  SSI  benefits  by  meeting  two 
criteria:  they  must  be  income  eligible  and  have  documentation  validating  that  they  had  a 
disability  on  the  SSI  list  of  impairments.  Disability  validation  could  be  based  on  the 
opinions  of  those  who  interacted  with  the  child  on  a  regular  basis  or  through  the  medical 
community.  One  validation  mechanism  was  to  enroll  a  child  in  a  special  education 
program  within  the  public  school  system.  Children  who  were  considered  disabled  in  the 
school  system  and  met  the  income  requirements  prior  to  PRWORA  were  eligible  to 
receive  benefits.  After  PRWORA,  the  requirements  drastically  changed.  Children  still 
had  to  meet  the  income  criteria,  but  validation  of  disability  became  very  strict.  Opinions 
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of  those  who  had  daily  interactions  with  the  child  were  no  longer  accepted  and  decisions 
were  based  on  medical  corroboration  of  disability.  This  change  was  a  direct  result  of 
intense  public  pressure  on  policymakers.  Due  to  the  explosion  in  SSI  enrollment,  and  the 
rapid  numbers  of  children  being  diagnosed  as  having  attention  deficit  hyperactivity 
disorder  (ADHD),  the  public  began  to  insist  that  parents  were  coaching  their  children  to 
behave  in  certain  ways  in  order  to  qualify  for  benefits.  By  making  the  criteria  tougher, 
parental  incentives  to  game  the  system  were  reduced. 

This  chapter  has  two  objectives.  First,  I  determine  if  PRWORA  had  an  effect  on 
the  number  of  children  who  were  classified  as  having  a  disability.  Using  a  large, 
detailed,  administrative  data  set  from  the  state  of  Florida,  an  individual  panel  is 
constructed.  Education  statistics  are  collected  on  three  cohorts  of  children  from  1992  to 
1999.  Having  such  a  large,  unique  set  of  panel  data  lends  itself  to  a  simple  but 
convincing  empirical  strategy.  Using  a  variety  of  empirical  models,  I  am  able  to  isolate 
the  effect  that  PRWORA  had  on  classification  rates.  Controlling  for  income  eligibility 
and  grade  transition,  I  determine  the  differential  effects  of  the  policy  on  subsections  of 
the  population.  In  addition,  I  am  able  to  take  advantage  of  the  panel  by  incorporating 
student  and  school  level  fixed  effects.  All  models  provide  evidence  that  PRWORA 
caused  the  overall  classification  rate  of  disabled  children  to  decrease  in  the  range  of  1 1  to 
19%.  When  both  student  and  school  level  fixed  effects  are  included,  the  results  show  that 
classification  rates  fell  by  12.66%. 

Second,  this  chapter  attempts  to  determine  the  effect  that  PRWORA  had  on 
parental  shopping.  Parental  shopping  refers  to  the  idea  that  a  parent  who  is  unable  to 
gain  disability  classification  for  his  or  her  child  might  move  to  another  school  district  that 


is  more  lenient.  Evidence  on  welfare-induced  migration  is  mixed  and  has  relied  on  inter- 
state analysis.  Not  only  does  this  chapter  focus  on  intra-state  migration,  but  also  it  does 
so  considering  parental  incentives  towards  disability  classification.  To  isolate  the 
affected  group,  I  only  consider  the  sample  that  gains  classification  over  one  year.  Using 
similar  controls  for  income  eligibility,  grade  transition  and  fixed  effects,  I  find  that  the 
probability  of  a  child  switching  school  districts  in  order  to  gain  classification  fell  after 
PRWORA.  Unfortunately,  even  incorporating  fixed  effects  may  not  produce  reliable 
results  since  parents  move  for  a  variety  of  reasons  not  captured  by  the  independent 
variables.  Therefore,  I  conclude  that  parental  ability  to  shop  for  a  new  district  fell 
following  PRWORA,  but  the  magnitudes  are  suspect  at  best. 

1.2  Birth  Vital  Statistics  and  the  Classification  of  Disabled  Children:  To  Use  or 

Not  To  Use? 

Chapter  3  of  this  dissertation  is  essentially  an  extension  of  the  previous  one. 
Again,  I  attempt  to  determine  if  PRWORA  had  an  effect  on  the  classification  rate  of 
disabled  children.  The  results  are  corroborated  in  two  ways.  First,  a  much  more 
complete  data  set  is  used  to  test  the  same  hypothesis.  The  advantage  to  using  a  larger 
data  set  is  that  concerns  of  attrition  are  addressed.  However,  the  disadvantage  is  that  the 
ability  to  exploit  student  and  district  level  fixed  effects  is  lost  due  to  computational 
constraints.  Regardless  of  this  disadvantage,  the  results  confirm  that  PRWORA  led  to  a 
significant  decrease  in  classification  rates  of  disabled  children.  Results  show  that  the 
policy  caused  a  decrease  in  overall  classification  of  6.4  to  8.2%. 

Next,  this  chapter  addresses  that  concern  that  health  indicators  may  contribute  to 
disability  prediction,  and  omitting  them  from  the  analysis  may  bias  the  results.  Matching 
the  education  data  to  birth  vital  statistics  by  identification  number  resulted  in  a  detailed 
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panel  data  set  that  was  used  in  the  analysis.  Variables  such  as  birth  weight,  apgar  scores 
and  mothers  age  at  birth  are  included  in  the  model  to  estimate  the  effects  of  PRWORA  on 
disability  status.  Accounting  for  these  health  indicators  does  not  change  the  initial 
finding,  that  PRWORA  caused  disability  classification  rates  to  fall.  Results  do  show, 
however,  that  the  magnitude  of  this  change  is  smaller  than  those  found  in  Chapter  2, 
albeit  with  no  fixed  effects,  at  7.05  to  9.4%. 

1.3  Did  Welfare  Reform  Help  or  Hurt  Disabled  Children? 
The  final  substantive  chapter  of  this  dissertation  probes  further  into  the  effects  of 
PRWORA  on  disabled  children.  Overwhelming  evidence  from  chapters  2  and  3  showed 
that  PRWORA  caused  a  decrease  in  the  overall  classification  rates  in  the  range  of  6.4  to 
19%.  Knowing  that  the  policy  had  an  effect  provokes  the  question  of  whether  that  effect 
was  helpful  or  detrimental  for  disabled  children.  In  order  to  answer  this  question,  a 
welfare  analysis  must  be  performed.  Disabled  children  may  have  gained  or  lost  from  the 
policy  change  which  reduced  the  number  of  classified  children.  For  example,  welfare 
gains  would  have  resulted  if  the  policy  resulted  in  a  more  efficient  use  of  resources. 
Recall  that  a  major  motivation  for  the  policy  change  was  the  idea  that  parents  were 
coaching  their  children  to  be  classified  as  having  a  disability.  This  means  that  children 
were  enrolled  in  special  education  programs  and  subsequently  removed  following  the 
policy  changes.  If  it  were  the  case  that  these  children  were  not  legitimately  disabled,  then 
removing  them  from  special  education  provided  a  better  match  of  disability  status  to 
appropriate  education  setting.  As  a  result,  standardized  test  scores,  which  are  the 
measure  of  student  outcomes  in  this  paper,  should  increase.  On  the  other  hand,  if 
children  were  not  being  coached  and  were  in  fact  disabled,  then  their  education  would 
suffer  as  manifested  in  lower  test  scores. 
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To  determine  which  of  these  effects  occurred,  I  use  data  from  two  large  and  diverse 
counties  in  the  state  of  Florida.  Administrative  data  are  matched  to  standardized  test 
score  data  for  each  child  from  1994  to  1999.  Panel  data  are  used  to  test  the  theory  in  two 

separate  empirical  strategies.  First,  I  attempt  to  estimate  the  welfare  effects  over  the 

- 

entire  population.  Controlling  for  income  eligibility,  race,  grade,  parent,  student  and 
school  effects,  I  am  able  to  estimate  the  policy  effect  on  those  children  who  were  not 
classified  as  having  a  disability  after  PRWORA.  For  both  math  and  reading  scores, 
children  who  were  not  classified  with  a  disability  after  the  policy  change  realized 
significant  increases  in  their  standardized  test  scores. 

Unfortunately,  the  effects  of  two  groups  are  confounded  in  these  results:  those 
children  who  were  never  classified  as  having  a  disability  and  those  who  were  classified 
prior  to  PRWORA  and  then  removed.  Of  course,  the  group  of  most  interest  is  those 
students  who  were  removed  from  special  education  since  one  of  the  policy's  objectives 
was  to  prevent  parental  coaching.  Separating  out  the  effects  on  each  group  of  children 
required  them  to  be  placed  into  groups  according  to  their  actual  classification  status. 
Four  indicators  are  constructed  according  to  alternative  combinations  of  classification 
before  and  after  the  policy.  Using  the  group  who  were  never  classified  as  the  control 
group,  the  effects  on  test  scores  for  the  other  three  groups  are  found.  Again,  taking 
advantage  of  school  level  fixed  effects,  I  find  that  children  who  were  classified  and  then 
removed  realized  welfare  gains.  Estimates  from  the  model  using  math  scores  as  the 
dependent  variable  show  that  the  change  in  coefficient  from  before  and  after  the  policy 
for  this  group  resulted  in  a  2.91  points  increase  in  math  scores  and  a  similar  increase  for 
reading  scores.  These  results  suggest  that  children  in  this  group  improved  following  the 
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policy  change.  Moreover,  the  results  imply  that  children  were  more  appropriately 
matched  to  their  education  setting  after  the  policy.  This  indicates  that  at  least  for  one  of 
its  objectives  PRWORA  was  successful.  Although  parental  coaching  is  hard  to  prove, 
empirical  evidence  from  this  dissertation  suggests  that  some  misclassification  was 
happening  prior  to  PRWORA. 


CHAPTER  2 

ANTI-POVERTY  PROGRAMS,  PARENTAL  INCENTIVES,  AND  THE 
CLASSIFICATION  OF  DISABLED  CHILDREN 

2.1  Introduction 

Public  educators  in  the  United  States  single  out  two  groups  of  children  as  being 
exceptional:  gifted  and  special  education  students.  While  both  groups  represent  a  small 
proportion  of  the  general  school  population,  they  are  separated  from  other  students  for 
different  reasons.  Special  education  students  are  often,  but  not  always,  separated  from 
other  students  in  order  to  provide  them  with  specialized  instruction.  This  specialized 
instruction  tends  to  be  time  intensive  and  costly.  Given  the  greater  demand  on  a  school's 
time  and  resources,  the  limited  amount  of  economic  research  that  focuses  on  these 
students  is  surprising.  Specifically,  research  is  needed  to  understand  the  effects  from 
recent  trends  in  special  education  financing  and  population  growth. 

Financing  issues  are  important  for  these  children  since  special  education  students 
draw  a  substantial  amount  of  funding  which  tends  to  greatly  impact  a  school's  budget. 
To  compensate  schools  for  the  additional  resources  required  to  educate  these  students, 
state  and  local  governments  allocate  a  set  amount  of  money  towards  each  child.  On 
average,  one-fifth  of  a  school's  budget  is  made  up  of  special  education  funding. 
Chambers  and  Parrish  (1996)  estimate  that  on  average  12%  of  national  school 
expenditures  are  designated  to  special  education.  Not  only  do  financing  issues  need  to  be 
considered,  but  also  the  trend  in  overall  growth  must  be  investigated.  Over  the  last  thirty 
years  the  special  education  population  has  grown  30%  faster  than  the  regular  student 
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population.  This  growth  has  been  attributed  to  four  major  trends.  One  trend  was  the 
development  of  screening  instruments  and  advanced  technologies  that  made  disability 
detection  more  accurate.  For  instance,  the  Denver  Developmental  Screening  Test  II  was 
created  in  1994  and  led  to  an  increase  in  the  detection  of  disabilities  in  early  childhood. 
A  second  trend  was  the  recognition  of  new  disabilities.  Mental  illnesses,  such  as  autism 
and  attention  deficit  hyperactivity  disorder  (ADHD),  were  not  recogni^d  as  disabilities 
by  the  medical  community  until  the  1980s.  Although  the  exact  cause  of  ADHD  has  not 
been  established,  the  number  of  outpatient  pediatric  visits  for  ADHD  from  1990  to  1993 
increased  from  1.7  to  4.2  million  (Terman  et  al.  1996).  Third,  school  and  parental  fiscal 
incentives  have  influenced  the  number  of  children  that  have  been  classified  as  having  as 
disability.  A  study  by  Lakdawalla  et  al.  (2001)  suggests  that  financial  incentives  and  an 
increase  in  underlying  health  problems  have  caused  the  young  to  become  more  disabled. 
Finally,  socio-demographic  factors,  such  as  poverty,  contributed  to  the  increase  in 
disability  rates.  Poverty  rates  in  the  United  States  have  steadily  risen  until  the  late  1990s. 
Since  children  living  in  poverty  are  more  likely  to  be  disabled,  this  should  have  also 
caused  the  number  of  disabled  children  to  increase. 

Another  reason  for  the  changes  in  disability  rates  over  the  past  thirty  years  has  been 
government  implementation  of  a  variety  of  laws  in  response  to  children's  needs. 
Government  has  gone  from  virtually  ignoring  disabled  children  to  creating  laws  to  protect 
and  provide  for  them.  The  legal  environment  that  surrounds  disabled  children  today  is  a 
culmination  of  a  handful  of  laws  and  programs.  Together  these  laws  and  programs  have 
created  incentives  for  both  parents  and  schools  to  identify  children  as  disabled.  The  1 990 
Individuals  with  Disabilities  Education  Act  (IDEA)  provided  schools  with  additional 
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funding  if  they  adopted  procedures  for  identifying  disabled  children.  As  a  result,  schools 
had  a  financial  incentive  to  identify  disabled  children.  The  primary  program  affecting 
parental  incentives  comes  from  provisions  incorporated  into  the  Supplemental  Security 
Income  (SSI)  program,  which  grants  financial  assistance  to  families  that  have  disabled 
children.  Initially,  the  criteria  for  children  to  receive  this  aid  were  more  restrictive  than 
for  adults,  but  as  the  result  of  a  1990  Supreme  Court  case,  Zebley  v.  Sullivan,  changes 
occurred  that  relaxed  the  criteria  for  children  to  qualify  for  benefits.  It  has  been  argued 
that  this  created  a  new  parental  incentive  to  identify  children  as  disabled.  Children  who 
previously  would  not  have  been  considered  for  SSI  suddenly  were  added  to  the  rolls. 

This  trend  to  increase  incentives  to  identify  children  as  disabled  continued  until 
1996  when  President  Clinton  signed  the  Personal  Responsibility  and  Work  Opportunity 
Reconciliation  Act  (PRWORA).  Included  in  the  legislation  were  tightened  criteria  for 
eligibility  along  with  a  new  review  procedure.  What  has  emerged  from  PRWORA  is  a 
change  in  the  mix  of  incentives.  While  school  incentives,  as  a  result  of  IDEA,  have  not 
changed,  parental  incentives  have.  My  dissertation  is  the  first  to  investigate  this  new 
incentive  mix.  In  particular,  this  chapter  determines  if  the  policy  had  any  effect  on  the 
classification  of  disability  in  children.  Previous  research  on  identifying  children  as 
disabled  has  focused  on  the  time  period  prior  to  PRWORA.  Also,  those  few  studies  have 
been  limited  by  the  data  utilized.  This  research  is  not  only  the  first  that  looks  at  these 
issues  since  PRWORA,  but  also  the  first  that  does  so  with  such  a  rich  data  set.  Using  a 
large,  individual  level  data  set  that  spans  a  significant  period  of  time  before  and  after 
PRWORA,  this  study  provides  evidence  that  the  change  in  the  incentive  mix  due  to 
PRWORA  had  significant  negative  impacts  on  the  classification  of  disabled  children. 
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Specifically,  the  policy  led  to  an  overall  reduction  in  disability  classification  among  all 
children  in  the  range  of  1 1  to  19%. 

Another  aspect  that  sets  this  research  apart  from  others  is  that  it  looks  at  how 
parents  game  the  system  in  order  to  obtain  the  classification  they  desire  for  their  child. 
Specifically,  this  chapter  examines  if  parents  change  school  districts  in  order  to  gain 
classification.  Results  from  the  analysis  show  that  the  policy  decreased  the  extent  to 
which  a  parent  gamed  the  system. 

Section  2.2  presents  the  background  of  the  programs  that  impacted  children  with 
disabilities.  Section  2.3  describes  the  data,  while  section  2.4  lays  out  the  empirical 
analysis  used  to  find  the  impact  of  the  change  in  incentives  due  to  PRWORA  on 
classification  rates.  Next,  section  2.5  describes  the  empirical  analysis  utilized  to 
determine  the  effect  of  PRWORA  on  a  parent's  ability  to  shop  for  a  new  school  district. 
Finally,  section  2.6  concludes  and  alludes  to  future  research. 

2.2  Background 

Government  treatment  of  disabled  children  has  gone  through  three  distinct  phases. 
From  1 974  to  1 990  the  initial  program  created  by  the  Social  Security  Act  was  put  into 
place.  The  year  1990  saw  two  major  events  that  significantly  altered  the  treatment  of 
disabled  children.  The  next  change  was  implemented  in  1996,  when  Congress  passed  the 
Personal  Responsibility  and  Work  Opportunity  Reconciliation  Act.  Each  of  these  phases, 
1974-1990,  1990-1996,  and  1996-present,  is  described  below. 
2.2.1  ?re-Zebley  v.  Sullivan  (1974-1990) 

In  1974,  under  title  XVI  of  the  Social  Security  Act,  the  Supplemental  Security 
Income  (SSI)  program  was  created.  The  program  was  enacted  to  provide  benefits  to  low- 
income  blind  and  disabled  adults  who  meet  certain  financial  requirements.  According  to 
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the  Office  of  Special  Education  Programs  (2000),  to  be  disabled  by  the  Social  Security 
Administration's  (SSA)  criteria,  an  adult  must  be  "unable  to  engage  in  any  substantial 
gainful  activity  due  to  a  medically  determined  physical  or  mental  impairment  expected  to 
result  in  death  or  that  has  lasted,  or  is  expected  to  last,  for  a  continuous  period  of  at  least 
12  months"  (np). 

Adults  whose  physician  certified  they  had  a  condition  included  on  the  SSA's 
Listing  of  Impairments  and  who  met  the  financial  criteria  automatically  qualified  for 
benefits.  Adults  who  met  the  financial  criteria,  and  had  conditions  not  included  on  the 
impairment  list  were  initially  rejected,  but  could  still  qualify  through  a  five-step  appeals 
process.  While  disabled  children  were  not  originally  the  focus  of  the  SSI  program, 
eventually,  they  too  were  allowed  to  qualify  for  SSI  benefits.  For  children,  a  portion  of 
the  parent's  income  counts  as  that  child's  "income."  This  countable  income,  which 
excludes  other  transfer  payments,  is  used  to  determine  if  the  child  is  financially  eligible 
for  SSI.  Upon  meeting  the  financial  requirements,  children  were  also  required  to  have  a 
condition  on  the  Listing  of  Impairment.  Unlike  adults,  however,  children  who  were 
rejected  had  no  opportunity  to  appeal. 

In  1975,  President  Gerald  Ford  signed  the  Education  for  All  Handicapped  Children 
Act.  Prior  to  this  act  many  disabled  children  were  either  excluded  from  the  public  school 
system,  or  they  received  inadequate  services.  Congress  found  that  "more  than  half  the 
handicapped  children  in  the  United  States  do  not  receive  appropriate  educational  services 
which  would  enable  them  to  have  full  equality  of  opportunity"  (Office  of  Special 
Education  Programs  2000).  This  act  required  that  public  school  systems  acknowledge 
and  provide  a  free  and  appropriate  education  for  handicapped  children.  Congress  was 
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authorized  to  appropriate  a  percentage  of  the  average  per  pupil  expenditure  for  funding 
the  education  of  disabled  children.  However,  appropriations  have  never  matched  the 
authorized  amount  of  funding.  Appropriation  amounts  peaked  in  the  1970s,  and  have 
continued  to  decrease  since  that  time. 

In  1984,  the  Disability  Benefits  Reform  Act  (DBRA)  was  passed.  This  new 
legislation  revised  the  listing  of  impairments  and  the  specific  methods  of  evaluation. 
This  was  done  to  incorporate  recent  advances  in  science  and  technology.  As  compared  to 
the  previous  impairment  requirements,  DBRA  included  functional  aspects  of 
impairments.  Although  this  legislation  helped  disabled  children  by  broadening  the 
number  of  acceptable  impairments,  its  impact  was  not  as  significant  as  the  drastic 
changes  that  occurred  in  1990. 
2.2.2  Zebley  to  PRWORA  (1990-1996) 

In  1990,  several  major  changes  for  disabled  children  occurred.  One  important 

piece  of  legislation  was  the  IDEA  law.  The  mission  of  the  IDEA  law  according  to  the 

Office  of  Special  Education  Programs  (2000)  was: 

to  ensure  that  all  children  with  disabilities  have  available  to  them  a  free 
appropriate  public  education  that  emphasizes  special  education  and  related 
services  designed  to  meet  their  particular  needs;  to  ensure  that  the  rights  of 
children  with  disabilities  and  their  parents  or  guardians  are  protected;  to 
assist  States  and  localities  to  provide  for  the  education  of  all  children  with 
disabilities;  and  to  assess  and  ensure  the  effectiveness  of  efforts  to  educate 
children  with  disabilities,  (np) 

This  law,  which  was  a  renamed  and  revised  version  of  the  Education  for  All 

Handicapped  Children  Act,  changed  the  way  that  schools  provide  a  free  and  appropriate 

public  education  for  disabled  children.  Each  program  must  meet  three  requirements:  it 

must  develop  an  individual  education  program  (IEP)  in  cooperation  with  parents  and 

teachers  for  each  disabled  child,  it  must  provide  services  as  needed,  and  it  must  review 
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and  re-evaluate  each  child  on  an  annual  basis  in  all  areas  related  to  their  disability. 
Services  that  the  school  must  provide  are  transportation,  speech  services,  psychological 
services,  physical  therapy,  counseling,  social  work,  and,  on  a  limited  basis,  medical 
services.  As  long  as  schools  implemented  approved  programs,  they  became  eligible  to 
receive  additional  funding  per  pupil.  In  Florida,  the  annual  expenditure  formula  for  a 
full-time  equivalent  (FTE)  student  includes  two  provisions  for  special  education.  First, 
expenditure  for  FTE  students  with  more  severe  disabilities  is  calculated  at  a  weighted 
level.  Funding  for  these  students  can  be  as  high  as  $13,964  and  $19,775  per  year. 
Next,  students  with  less  severe  disabilities  draw  extra  monies  from  the  exceptional 
student  education  (ESE)  Guaranteed  Allocation  fund.  As  long  as  districts  meet  the 
requirements,  they  receive  a  lump  sum  amount  based  on  the  proportion  of  disabled 
students  in  their  district.  In  2002,  the  ESE  Guaranteed  Allocation  ranged  from  $3 15,835 
to  $130,531,818  (Florida  Department  of  Education  2002).  An  externality  was  created  as 
this  gave  schools  a  way  to  expand  their  already  thin  budget  sets.  Fiscal  incentives  were 
created  for  schools  to  identify  children  as  disabled.  Table  2- 1  shows  the  total  number  of 
children  served  nationally  by  IDEA  in  the  two  school  years  of  1989-90  and  1998-99,  by 
specific  categories  (Office  of  Special  Education  Programs  2000).  This  table  shows  that 
the  number  of  children  with  any  disability  grew  30%  from  1989-1990  to  1998-1999 
school  years.  This  growth  in  the  number  of  students  served  with  disabilities  was  far 
greater  than  the  growth  in  school  enrollment,  which  rose  14.1%  during  that  time  frame 

1  For  example,  FTE  for  these  children  are  weighted  by  a  factor  of  1.8  for  transportation 
expenditures  (Florida  Department  of  Education  2002). 

2  These  figures  are  for  the  2002-03  school  year.  State  average  FTE  is  $7,023  (Florida 
Department  of  Education  2002). 
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(Office  of  Special  Education  Programs  2000).  Figures  2-1  and  2-2  augment  this  table  by 
showing  the  yearly  change  in  number  of  students  served  by  IDEA  for  both  the  entire 
United  States  and  the  state  of  Florida.  These  figures  indicate  that  the  increase  in  the 
number  of  children  served  was  relatively  constant  over  time. 

In  addition  to  IDEA,  the  other  major  change  in  children's  disability  legislation 
emerged  in  1990,  from  a  Supreme  Court  ruling,  Zebley  v.  Sullivan.  The  Court  ruled  that 
SSA  could  not  hold  children  to  a  higher  standard  of  disability  than  adults,  as  had 
previously  been  the  case.  In  addition  to  Zebley,  the  SSA  issued  new  procedures  for 
diagnosing  children's  mental  disabilities.  Less  emphasis  was  placed  on  medical  opinion, 
and  more  was  placed  on  the  input  from  parents,  educators,  and  those  who  interact  with 
the  child  on  a  daily  basis.  Most  important  was  the  assessment  of  how  a  child's  disability 
prevented  him/her  from  functioning  like  an  unimpaired  child  of  the  same  age.  One  result 
of  Zebley  was  a  mandate  that  called  for  the  creation  of  the  Individual  Functional 
Assessment  (IF A)  and  a  committee  that  focuses  on  how  the  child's  disability  affects  his 
or  her  school  performance.  The  IFA  committee  allows  children  who  were  initially 
rejected  from  the  program  to  be  reevaluated.  Now  children  with  less  severe  impairments 
could  still  qualify  for  benefits  if  they  were  functionally  disabled.  What  followed  the 
court's  decision  was  an  explosion  of  SSI  enrollment.  For  example,  at  the  end  of  1990, 
340,000  children  were  on  the  SSI  rolls,  and  by  1996  that  figure  climbed  to  nearly  1 
million.  In  1995,  over  200,000  children,  approximately  one-third  of  the  new  enrollees, 
had  been  awarded  benefits  based  on  the  less  severe  IFA  requirements  (US  General 
Accounting  Office  1995).  For  example,  the  number  of  awards  for  mental  impairments, 
other  than  retardation,  increased  22%  by  1994  with  the  majority  being  attention  deficit 
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hyperactivity  disorder  and  personality  disorder.  Overall  enrollment  almost  tripled 
following  the  Zebley  case. 
2.2.3  PRWORA  to  Present 

After  the  dramatic  change  in  SSI  enrollment,  the  public  began  to  question  the 
integrity  of  the  program.  As  a  result  of  the  Zebley  case,  a  parental  incentive  was  created 
to  identify  children  as  disabled.  Many  alleged  that  parents  were  coaching  their  children 
to  appear  disabled  in  order  to  qualify  for  the  almost  $5,500  annual  supplement. 
Coaching,  though  hard  to  prove,  could  lead  to  fraud  and  abuse  of  the  SSI  program. 

During  the  Clinton  administration  welfare  reform  became  a  top  priority.  On 
August  22,  1996,  President  Clinton  signed  the  PRWORA  bill  into  law.  This  monumental 
piece  of  legislation  revamped  the  welfare  system,  reduced  food  stamp  funding,  and 
tightened  child  eligibility  for  SSI  benefits.  The  act  eliminated  the  IFA  process  as  well  as 
references  to  maladaptive  behavior  in  the  impairment  listing.  Disability  by  definition 
now  required  that  a  child  have  "a  medically  determinable  physical  or  mental  impairment 
or  combination  of  impairments  that  causes  a  marked  and  severe  functional  limitations." 
The  impairment  must  last  at  least  12  months,  or  until  death.  In  these  circumstances  the 
term  "marked"  means  moderate,  but  less  than  extreme.  A  final  requirement  of  PRWORA 
was  that  SSA  must  perform  a  continuing  disability  review  (CDR)  every  three  years  for 
children  under  eighteen  to  determine  eligibility  status.  Children  who  previously  were 
placed  on  the  rolls  because  they  met  IFA  requirements  had  to  be  reevaluated  under  the 
more  strict  guidelines.  Evidence  must  be  presented  during  the  CDR  re-evaluations  that 
the  child  has  been  treated  for  his  or  her  impairment. 

Figure  2.3  gives  an  overview  of  the  number  of  SSI  recipients  under  the  age  of  18, 
in  the  month  of  December  each  year  for  a  ten-year  period.  As  expected,  the  number  of 
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SSI  recipients  rose  each  year  until  1996  when  PRWORA  was  passed,  then  declined  each 
year  after. 

The  implementation  of  PRWORA  has  led  to  a  dramatic  change  in  the  mix  of 
incentives.  The  IDEA  laws  remain  intact,  and  therefore,  schools  still  have  an  incentive  to 
"game"  the  system  and  classify  children  as  disabled.  However,  financial  incentives  on 
the  part  of  parents,  while  not  completely  eliminated,  have  been  substantially  reduced. 
Naturally,  questions  of  the  effect  of  the  policy  on  classification  arise.  This  dissertation  is 
the  first  that  deals  with  the  effects  following  PRWORA.  By  estimating  the  effect  of 
PRWORA  on  classification,  the  merits  or  detriments  of  the  policy  can  begin  to  be 
understood. 

In  addition,  this  study  is  the  first  to  investigate  the  idea  that  parents  could  "shop" 
around  for  a  district  that  would  classify  their  child  as  having  a  disability.  Prior  to 
PRWORA,  it  would  have  been  easier  to  change  school  districts  in  order  to  gain 
classification.  During  that  time,  the  opinions  of  parents  and  school  personnel  were 
enough  to  get  a  child  classified  and  receive  the  SSI  benefits  that  accompanied  this.  One 
scenario  could  be  that  if  parents  are  unable  to  get  their  child  classified  in  one  district,  they 
might  just  change  districts  in  order  to  gain  the  desired  classification.  After  the  policy 
implementation,  this  idea  of  shopping  for  an  accommodating  district  would  be  harder. 
Following  the  policy,  it  was  no  longer  acceptable  to  have  only  the  opinions  of  parents  and 
school  employees.  In  making  the  criteria  stricter,  one  would  expect  to  see  a  decrease  in 
the  extent  to  which  parental  shopping  occurred  among  districts. 
2.2.4  Existing  Literature 

The  existing  literature  on  children's  disability  programs  is  sparse,  and  deals  only 
with  the  period  prior  to  PRWORA.  A  paper  by  Cullen  and  Figlio  (1998)  related  to  the 
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IDEA  law  provided  evidence  that  increased  school  fiscal  incentives  did  lead  to  significant 
increases  in  categorizing  slow  learners  as  remedial.  By  using  school  and  district  level 
data  from  the  Schools  and  Staffing  Survey  (SASS),  their  paper  showed  that  "gaming"  by 
schools  led  to  an  increase  in  the  classification  of  disability,  and  an  increase  in  a  school's 
budget  set.  Of  course,  even  when  schools  have  a  fiscal  incentive  to  identify  children  as 
disabled,  there  are  accompanying  costs  in  doing  so.  Taking  costs  into  account  is  beyond 
the  scope  of  this  research,  but  it  is  important  to  acknowledge  those  costs. 

Of  the  few  papers  concerning  the  children's  SSI  program,  all  examine  the  effects  of 
the  Zebley  v.  Sullivan  case.  Kubik  (1999)  examined  how  SSI's  generosity  following  the 
Zebley  case  affected  the  probability  that  children  would  be  enrolled  in  the  program. 
Using  data  from  the  National  Health  Institute  Survey  (NHIS)  and  the  Current  Population 
Survey  (CPS),  Kubik  found  that  following  the  court  case  families  were  more  likely  to 
place  children  onto  the  SSI  rolls.  As  an  extension  to  this,  Kubik  (2001)  looked  at  states' 
incentives  to  shift  participants  from  SSI  to  Aid  to  Families  with  Dependent  Children 
(AFDC)  programs.  A  similar  paper  by  Garrett  and  Glied  (1997)  utilized  state  level  data 
from  SSA  surveys  also  examined  the  effect  of  spillovers  between  SSI  and  AFDC 
following  Zebley.  Garrett  and  Glied  found  that  Zebley  increased  SSI  participation  by 
43%  overall,  and  did  so  more  in  states  with  lower  AFDC  payments. 

2.3  Description  of  Data 

Since  the  purpose  of  this  research  is  to  investigate  the  effect  of  the  passage  of  the 
1996  PRWORA  legislation  on  the  probability  of  being  classified  with  an  exceptionality, 
individual  level  panel  data  are  needed  for  a  time  period  that  spans  before  and  after  the 
passage  of  the  bill.  In  this  research,  data  from  twenty-one  districts  in  the  state  of  Florida 
will  be  utilized.  The  districts,  which  are  the  same  as  counties  in  Florida,  collected  data 
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beginning  in  1992.  For  each  child  in  the  public  school  system  that  entered  kindergarten 
in  those  twenty-one  counties  in  the  1992-1993  school  year,  education  statistics  were 
collected  by  name,  sex,  race,  and  birth  date.3  These  data  were  collected  each  year,  until 
the  1999-2000  school  year.  Children  in  these  data  are  referred  to  as  the  oldest  cohort  in 
the  data.  Two  additional  cohorts  were  also  available  for  use,  which  entered  kindergarten 
in  1993-1994,  and  1994-1995.  For  the  purposes  of  this  research,  these  cohorts  will  be 
referred  to  as  cohort  1,  2  and  3,  with  1  being  the  oldest  (1992-1993)  group  and  3  the 
youngest  (1994-1995).  Cohort  1  consists  of  34.3%  of  the  total  population,  while  cohorts 
2  and  3  count  for  34.8%  and  30.9%.  It  should  again  be  stressed  that  each  child  entering 
kindergarten  in  one  of  these  twenty-one  counties  in  the  Florida  public  school  system 
during  the  cohort's  particular  year  is  included  in  the  data,  which  is  important  because  no 
selectivity  bias  exists  among  publicly  educated  children.  Astoundingly,  with  three 
cohorts  of  children,  and  data  on  each  child  for  up  to  eight  years,  the  result  is  a  data  set 
with  over  one  million  observations. 

This  individual  data  set  is  the  largest  one  available  that  assembles  the  education 
statistics  needed  for  the  analysis.  The  data  is  impressive  in  both  its  volume  and  content. 
Appendix  A  provides  a  description  of  variables  that  are  used  in  this  dissertation.  The 
CLASSIFIED  variable,  which  is  short  for  classified  with  a  primary  exceptionality,  is  one 
of  the  most  important  variables  in  the  study.  This  dummy  variable  takes  the  value  1 


3  Average  private  school  enrollment  over  the  same  21  school  districts  during  this  time 
period  ranged  from  9.31  to  10.55%.  Although  individual  private  school  data  were 
unavailable  for  this  study,  the  results  should  not  suffer  from  selectivity  bias.  Since 
private  schools  charge  tuition  for  enrollment,  parents  who  send  their  child  to  private 
school  pay  both  tuition  and  local  taxes.  Moreover,  the  group  of  interest  in  this  study  is 
income  eligible  for  SSI.  These  families  would  not  have  been  able  to  afford  private  school 
costs. 
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when  the  school  classifies  a  child  as  having  a  disability  and  0  otherwise.  When  a  school 
initially  classifies  a  child  as  having  an  exceptionality,  they  must  document  what  that 
specific  disability  is.  Specific  disabilities  considered  in  the  category  of  exceptionality  are 
listed  in  Appendix  B.  Using  the  summary  statistics  for  the  data  in  Table  2-2  as  a 
reference,  in  the  entire  population,  15%,  or  over  156,000,  are  classified  with  an 
exceptionality.  It  should  be  noted  that  although  gifted  is  another  type  of  exceptionality 
classification,  those  children  are  not  considered  in  this  analysis.  Grouping  all  three 
cohorts  together,  we  can  describe  some  other  traits  of  our  population.  In  the  population, 
58.21%  of  the  children  are  within  185%  of  the  poverty  line  and  qualify  for  free  and/or 
reduced  lunch,  and  58%  are  white.  Using  free  and/or  reduced  lunch  as  a  proxy,  these 
children  will  constitute  the  group  that  meets  the  income  eligibility  requirement  for  SSI, 
and  will  be  referred  to  as  income  eligible. 

Comparatively,  as  shown  in  Table  2-2,  the  characteristics  of  the  population 
classified  as  having  an  exceptionality  differ  in  a  variety  of  ways  from  the  general 
population.  For  the  respective  cohorts,  15.4%  of  cohort  1  has  been  classified  with  a 
disability  across  all  years,  while  cohorts  2  and  3  have  14.9%  and  14.7%  across  all  grades. 
The  sample  of  disabled  children  has  a  similar  percentage  white  at  56%,  but  has  a  much 
higher  percentage  of  income  eligible  children  at  68%.  The  fraction  of  children  who  meet 
the  income  eligibility  requirement  and  are  disabled  is  17.67%,  while  only  1 1.40%  of 
those  above  the  eligibility  benchmark  are  disabled.  By  district,  the  mean  number  of 
disabled  children  ranges  from  1 1%  to  19%.  More  interesting  is  the  mean  of  disabled 
students  by  grade.  From  kindergarten  to  first  grade  the  mean  jumps  from  8.6%  to  13.1%, 
an  increase  in  4.5%.  Then,  the  increase  from  first  to  second  is  2.1%.  Finally,  the 
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transition  from  second  to  third  leads  to  a  2.0%  increase  in  the  mean  number  of  children 
being  classified.  After  the  third  grade,  the  fraction  of  disabled  students  becomes  more 
constant,  and  at  some  point  begins  to  decrease.  Figures  2.4,  2.5,  and  2.6  show  the  trend 
of  classification  rates  of  disability  over  time  for  all  three  cohorts.  These  trends  are  also 
separated  into  income  eligible  and  not  eligible  children.  The  three  figures  illustrate  that 
the  gap  between  income  eligible  and  not  eligible  widens  as  the  cohorts  progress  through 
the  school  years. 

One  of  the  major  contributions  of  this  research  is  the  data  being  utilized.  By  using 
such  a  large,  rich  and  unique  individual  level  data  set,  as  opposed  to  survey  data  for 
instance  which  lends  itself  to  selectivity  bias,  this  research  differentiates  itself  from  all 
previous  work  done  on  children's  SSI  enrollment  issues. 

2.4  Empirical  Analysis  for  Classification  Rates 
2.4.1  Identification  Strategy 

The  first  hypothesis  that  is  tested  in  this  research  is  whether  PRWORA  had  an 
effect  on  classification  rates  of  disabled  children.  Attempting  to  answer  this  question 
empirically  requires  developing  the  most  efficient  econometric  model  possible.  Models 
used  in  this  analysis  are  difference  in  difference,  ordinary  least  squares  and  non  linear. 
All  three  methodologies  are  used  to  estimate  the  effect  of  PRWORA  on  classification  of 
disabled  children.  This  section  includes  a  description  of  the  models  used,  and  a 
discussion  of  the  results. 
2.4.1.1  Difference  in  difference  in  difference 

In  order  to  correctly  isolate  the  policy  effect  from  other  mitigating  effects,  various 
econometric  methods  will  be  employed.  The  difference  in  difference  approach  is  not  the 
only  strategy  used  in  this  analysis,  but  is  perhaps  the  one  that  yields  itself  to  the  easiest 
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interpretation  and  more  importantly,  it  eliminates  mitigating  affects  from  other 
educational  and  legislative  changes  that  may  have  occurred  during  the  same  time  period. 
Originally  used  by  Gruber  and  Madrian  (1994),  this  identification  strategy  utilizes  simple 
techniques  to  quantify  treatment  effects.  By  using  the  following  grid,  the  difference  in 
difference  methodology  can  be  easily  explained. 


Group  1 

Group  2 

Yes 

A 

B 

B-A=C 

No 

D 

E 

E-D=  F 

Difference  in 
difference 

C-F=G 

The  purpose  of  this  research  is  to  identify  the  policy  effect  on  the  probability  that  a 
child  will  be  identified  as  disabled.  Therefore,  the  dependent  variable  of  interest  is  a 
probability  between  0  and  1.  Each  cell  represents  the  mean  probability  of  being 
identified  for  a  specific  set  of  observations.  Suppose  that  the  population  can  be  divided 
into  two  groups;  group  1  is  a  control  group  that  was  not  subjected  to  the  policy  change, 
and  group  2  is  a  treatment  group  that  was.  Further,  suppose  that  "Yes"  and  "No"  is  some 
criterion  that  affects  the  probability  that  classification  will  occur  in  a  way  that  interacts 
with  a  potential  policy  change.  Then  the  cell  labeled  A  represents  the  mean  probability 
of  being  identified  as  disabled  for  all  those  individuals  in  group  1  that  satisfy  the  "Yes" 
criterion.  Likewise,  cell  E  is  the  mean  probability  of  being  identified  as  disabled  for 
those  individuals  in  group  2  who  fail  to  satisfy  the  "Yes"  criterion.  Cell  C  represents  the 
difference  between  the  two  mean  probabilities  of  being  identified  for  group  1  and  group  2 
among  all  the  "Yes"  individuals.  Cell  F  represents  the  difference  between  the  two  mean 
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probabilities  of  being  identified  for  group  1  and  group  2  among  the  "No"  individuals. 
Finally,  cell  G  represents  the  difference  in  difference  between  cells  C  and  F.  Taking  the 
difference  in  difference,  seen  in  cell  G,  shows  the  additional  affect  of  "Yes"  once  the 
policy  change  has  occurred.  This  approach  controls  for  any  other  factors,  in  addition  to 
the  policy  change,  which  may  have  affected  the  probability  over  time.  It  is  assumed  that 
these  others  factors  affect  the  "Yes"  and  "No"  populations  symmetrically. 

A  variation  of  this  basic  methodology  is  actually  applied  in  this  research.  Since 
several  factors  affect  the  classification  of  disability,  this  study  takes  a  third  difference  to 
correctly  isolate  the  policy  effect.  First,  an  income  eligibility  indicator  is  used  as  a 
criterion  that  affects  the  classification  of  disability.  The  change  in  policy  will  create 
differential  incentives  for  parents  whose  incomes  are  low  enough  to  meet  the  eligibility 
requirements  and  those  who  do  not.  Also,  children  in  low-income  families  are  40%  more 
likely  to  be  afflicted  with  a  disability  (Kubik  1999).  Therefore,  if  children  who  are 
income  eligible  are  separated  out,  it  is  expected  that  their  probability  of  being  disabled 
will  be  higher  than  those  not  income  eligible.  This  more  frequent  classification  is  not  due 
to  the  policy  change,  and  must  be  controlled  for. 

Another  factor  that  changes  a  child's  chances  of  being  identified  is  their  school 
grade.  In  reality,  most  disabled  children  are  not  classified  upon  entry  into  elementary 
school.  Other  than  the  very  obvious  disabilities,  such  as  physical  handicaps  and  severe 
mental  retardation,  it  generally  takes  one  to  two  years  to  diagnose  a  child  as  having  a 
hard  to  observe  exceptionality.  Therefore,  many  children  will  not  have  been  diagnosed 
prior  the  second  grade.  As  previously  seen  in  the  raw  data,  it  is  expected  that  the  primary 
movement  from  being  not  classified  to  being  classified  occur  in  the  kindergarten  to  third 
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grades.  To  account  for  this  in  the  study,  it  is  important  to  control  for  the  classification  of 
disabled  children  as  they  make  the  transition  from  kindergarten  to  second  grade.  All 
other  grades  are  dropped  from  the  sample.  If  it  is  expected  that  most  children  will  be 
classified  by  second  grade,  that  effect  must  be  isolated  by  the  creation  of  a  second  grade 
dummy.  Because  the  dummy  equals  1  when  the  child  is  in  second  grade,  and  0  for 
kindergarten,  an  increase  in  classification  is  expected.  Again,  this  expected  change  in 
classification  is  not  due  to  the  policy,  so  it  must  be  controlled  for. 

If  both  of  these  aspects,  income  eligibility  and  grade,  are  expected  to  affect  the 
probability  of  being  identified  as  disabled,  how  can  the  effect  of  the  policy  be  isolated? 
Doing  so  requires  that  a  treatment  and  control  group  be  constructed.  Utilizing  different 
cohorts  can  easily  do  this.  Cohort  1,  which  is  the  oldest  cohort,  started  school  in  the 
1992-1993  calendar  year.  When  the  policy  change  took  place  in  1996,  these  children 
were  in  the  fourth  grade.  Therefore,  the  expected  change  from  kindergarten  to  second 
grade  had  already  occurred,  as  had  the  effect  of  eligibility.  As  a  direct  comparison, 
cohort  3,  the  youngest  group,  started  kindergarten  prior  to  PRWORA,  and  entered  second 
grade  after  the  policy  change.  From  this,  two  groups  emerge.  The  control  group, 
unaffected  by  the  policy,  consists  of  the  older  cohort  as  they  transition  from  kindergarten 
to  second  grade,  taking  their  eligibility  status  into  account.  Comparatively,  the  treatment 
group,  affected  by  the  policy,  consists  of  the  younger  cohort  as  they  transition  form 
kindergarten  to  second  grade,  taking  their  eligibility  status  into  account.  Constructing  the 
control  and  treatment  groups  in  this  manner  isolates  the  policy  effect  from  the  overall 
temporal  trends. 
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Table  2-3,  shows  the  difference  in  difference  in  difference  results.  Here  the 
dependent  variable  is  the  probability  that  a  child  is  classified  as  having  a  disability. 
Dividing  the  table  into  two  parts,  cohort  1  and  cohort  3  will  make  the  explanation  clearer. 
Dealing  with  cohort  1  only,  the  control  group,  the  first  cell  shows  that  0. 104 4  is  the  mean 
probability  of  being  identified  as  having  a  disability  for  kindergarteners  that  are  income 
eligible.  It  is  expected  that  the  next  cell  on  this  row  will  be  greater  in  magnitude  as  we 
take  the  transition  of  grades  into  account.  This  is  confirmed,  as  .  1 84  is  the  mean 
probability  of  being  identified  as  having  a  disability  for  second  graders  who  are  income 
eligible.  In  row  two  the  first  cell  reports  that  .081  is  the  mean  probability  of  being 
identified  as  having  a  disability  for  kindergarteners  not  income  eligible.  Finally,  .129  is 
the  mean  probability  of  being  identified  as  having  a  disability  for  second  graders  not 
income  eligible,  which  is  greater  again  due  to  the  grade  transition.  The  third  cell  in  row 
one  shows  that,  for  all  children  who  are  in  the  control  group  and  are  income  eligible,  the 
difference  between  the  two  mean  probabilities  of  being  identified  is  .080.  It  should  be 
noted  that  to  obtain  the  correct  standard  errors  for  this  estimate,  a  simple  regression  was 
performed.5  Since  this  is  for  children  who  are  income  eligible,  we  expect  that  the 
difference  between  kindergarteners  and  second  graders  will  be  larger  than  the  same 
difference  for  the  not  eligible  group.  In  fact,  this  is  what  occurs,  as  seen  in  the  cell 
directly  below  it,  where  the  difference  in  means  is  .047  and  the  eligible  group  has  a 
smaller  growth  rate.  Finally,  the  difference  in  kindergarteners  and  second  graders 

4  Standard  deviations  are  presented  in  Table  2-3  for  the  differenced  cells 

5  The  regression  used  is  CLASSIFIEDit=  ait+  pSECONDit  +  yELIGIBLEi, 
+CELIGIBLEit*SECONDit+  Hit 
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probabilities  by  eligibility  status  is  taken  for  the  control  group.  For  cohort  1,  the 
difference  in  difference  is  .032  with  a  standard  error  of  .004.  Another  interpretation 
would  be  that  there  is  a  .03  increase  in  growth  over  grades  in  the  probability  of  being 
identified  as  disabled  among  the  income  eligible  as  opposed  to  the  non-eligible. 

Next,  the  same  analysis  is  done  for  the  treatment  group,  or  the  group  that  was 
affected  by  the  policy  change.  Again,  similar  results  in  sign  are  expected,  but  in  different 
magnitude  because  the  policy  effect  has  been  added.  The  first  cell  shows  that  0. 100  is  the 
mean  probability  of  being  identified  as  having  a  disability  for  kindergarteners  that  are 
income  eligible.  Like  in  the  case  of  cohort  1,  it  is  expected  that  the  next  cell  be  greater  in 
magnitude  as  we  take  the  transition  of  grades  into  account.  Since  .  1 79  is  the  mean 
probability  of  being  identified  as  having  a  disability  for  second  graders  who  are  eligible, 
the  expectation  is  met.  In  row  two,  .065  is  the  mean  probability  of  being  identified  as 
having  a  disability  for  kindergarteners  not  income  eligible.  Finally,  .135  is  the  mean 
probability  of  being  identified  as  having  a  disability  for  second  graders  not  income 
eligible,  which  is  greater  due  to  the  grade  transition.  As  in  cohort  1,  the  third  cell  in  row 
one  shows  that  for  all  children  who  are  in  the  treatment  group  and  are  eligible,  the 
difference  between  the  two  mean  probabilities  of  being  identified  is  .078.  Cell  three  in 
row  two  shows  that  for  all  children  who  are  in  the  control  group  and  are  not  eligible,  the 
difference  between  the  two  mean  probabilities  of  being  identified  is  .071,  lower  than  the 
eligible  group.  Finally,  the  difference  in  kindergarteners  and  second  graders  probabilities 
by  eligibility  status  is  taken  for  the  control  group.  For  cohort  3,  the  difference  in 
difference  is  .007  with  a  standard  error  of  .004.  Again,  another  interpretation  would  be 
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that  there  is  a  .07  increase  in  growth  over  grades  in  the  probability  of  being  identified  as 
disabled  among  the  income  eligible  as  opposed  to  the  non-eligible. 

Finally,  the  difference  in  difference  in  difference  is  taken  to  isolate  the  policy 
effect.  This  estimate,  which  will  isolate  the  policy  effect  through  the  final  difference  in 
cohorts,  will  be  determined  using  a  similar  strategy  as  Figlio  and  Rueben  (2001).  In 
order  to  obtain  the  correct  standard  error,  a  regression  must  be  performed. 

The  equation  used  becomes: 

(1)      CLASSIFIED^  oit+  pSECONDit+  yELIGIBLEit  +  6COHORTit  + 
eELIGIBLEit  *  COHORT,  +CELIGIBLEit*SECONDit  +  nCOHORT,  * 
SECONDjt  +  9ELIGIBLEit  *  COHORT*  *  SECONDit+uit 

where  i  indicates  individual,  and  t  indicates  time. 

The  difference  in  difference  in  difference  cell  in  Table  2-3  represents  an  estimate  of 
the  0  in  the  above  equation.  This  coefficient,  9,  is  predicted  to  be  negative,  because  as 
parents  who  are  income  eligible  lost  the  incentive  to  identify  their  children,  they  behaved 
more  like  non-eligible  parents  before  PRWORA,  controlling  for  the  grade  transition.  The 
estimate  -.025  represents  the  difference  between  kindergarten  and  second  graders  in  the 
difference  between  income  eligible  and  not  income  eligible  children  in  the  difference 
between  the  older  and  younger  group  of  children,  holding  all  other  characteristics 
constant.  Therefore,  the  policy  caused  classification  of  income  eligible  children  who 
have  disabilities  to  fall  by  .025.  This  decrease  can  be  interpreted  by  dividing  0.25  by  the 
fraction  of  the  population  that  is  disabled,  which  in  this  research  is  .15.  Thus,  the  policy 
leads  to  a  17%  reduction  in  overall  classification  of  disabled  children. 
2.4.1.2  Ordinary  least  squares  regression 

To  test  the  robustness  of  these  results  utilizing  a  different  method,  an  ordinary  least 
squares  regression  is  performed  using  the  same  regression  equation  as  in  the  difference  in 
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difference  in  difference  approach.  Table  2-4  illustrates  those  results,  and  as  expected, 

they  are  almost  identical  to  the  previous  results.  A  positive  coefficient  on  income  eligible 

confirms  that  children  who  live  in  income  eligible  families,  are  in  kindergarten,  and  are  in 

cohort  1  are  more  likely  to  be  classified.  The  second  grade  dummy  again  comes  in 

positive,  showing  that  as  children  transition  from  kindergarten  to  second  grade  their 

probability  of  being  identified  becomes  greater.  Finally,  the  interaction  of  income 

eligible,  second  grade  dummy,  and  cohort  gives  us  the  exact  result  as  previously.  For  a 

child  in  cohort  3,  in  the  second  grade,  and  who  is  income  eligible,  the  probability  that  he 

or  she  is  identified  falls  by  .025  as  compared  to  the  same  child  in  the  younger  cohort. 

However,  this  strategy  is  clearly  miss-specified.  A  number  of  other  factors  could 

potentially  contribute  to  the  probability  of  being  classified  with  an  exceptionality,  leading 

to  biased  results.  Each  child  has  specific  individual  characteristics  that  may  make  him  or 

her  more  of  less  likely  to  be  classified.  In  an  attempt  to  control  for  differences  in  each 

child's  propensity  to  be  classified,  it  is  necessary  to  control  for  individual  fixed  effects. 

The  regression  equation  becomes: 

(2)      CLASSIFIED^  =  ait  +  pSECONDit  +  yELIGIBLEit+  6COHORTit  + 
eELIGIBLEit  *  COHORTt  +^ELIGIBLEit*SECONDit  +  nCOHORTit  * 
SECONDi,  +  eELIGIBLEit  *  COHORT,  *  SECONDit  +  kj  +Uit 

where  i  indicates  individual,  t  indicates  time  and  k\  is  the  fixed  effects  parameter. 

In  order  to  compare  the  two  specifications,  the  same  cohorts  and  grade  dummies 

were  used.  Specification  1  in  Table  2-5  reports  the  results  when  individual  level  student 

fixed  effects  are  incorporated.  As  in  the  previous  model,  it  is  expected  that  the 

coefficient  on  income  eligible  and  the  second  grade  dummy  will  be  positive.  The 

positive  and  significant  coefficient  from  specification  1  indicates  that  more  children  are 
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classified  as  having  an  exceptionality.  This  is  consistent  with  the  difference  in  difference 
signs  from  Table  2-3,  and  the  ordinary  least  squares  from  Table  2-4. 

Next,  the  effect  of  the  policy  is  examined.  For  specification  1  the  estimate  for  0  is  - 
.016  with  a  standard  error  of  .004.  Again,  this  decrease  can  be  interpreted  by  dividing 
.016  by  the  fraction  of  the  population  that  is  disabled.  The  policy  led  to  an  1 1% 
reduction  in  overall  classification  of  disabled  children.  Since  this  estimate  is  of  a  smaller 
magnitude  than  that  from  Tables  2-3  or  Table  2-4,  it  could  be  that  case  that  failing  to 
control  for  variations  across  individual  led  to  results  that  were  biased  upwards. 

Another  factor  that  must  be  controlled  for  is  that  classification  may  vary  across 
districts.  In  1997,  changes  were  made  to  the  IDEA  law  due  to  the  lack  of  measurable 
short-term  objectives,  failure  to  assess  students  and  lack  of  involvement  of  regular 
educators.  Objectives  of  the  amendments  were  to  increase  expectations  for  disabled 
students,  increase  parental  involvement,  include  regular  educators  in  the  development  of 
a  student's  IEP  and  increase  the  number  of  students  being  assessed.  Implementation  of 
these  changes  was  delayed  until  July  1,  1998,  but  districts  may  have  taken  the  initiative  to 
implement  the  changes  earlier.  As  a  result,  the  aggressiveness  of  classification,  the 
timing  and  the  process  may  have  differed  across  districts.  To  incorporate  these 
differences  at  the  district  level,  district  level  fixed  effects  were  included.  Table  2-5 
shows  the  results  of  specifications  2  and  3.  Specification  2  includes  the  district  fixed 
effects,  while  specification  3  includes  both  district  and  student  fixed  effects.  Results 
from  these  two  specifications  agree  with  all  previous  results,  in  that  the  effect  of  the 
policy  was  to  decrease  classification.  In  the  case  of  district  fixed  effects  alone,  the 
decrease  was  .021.  After  converting  the  effect  to  the  fraction  in  the  population  disabled, 
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it  can  be  concluded  that  a  14%  overall  reduction  in  classification  was  caused  by  the 
policy.  Alternatively,  the  specification  that  controls  for  both  district  and  student  fixed 
effects  yields  a  .019  decrease  in  classification.  Overall,  the  policy  led  to  a  12.7% 
decrease  in  classification. 

2.4.1.3  Sensitivity  analysis 

From  the  previous  analysis,  it  is  clear  that  the  policy  change  created  different 
incentives  for  eligible  and  ineligible  individuals.  However,  the  robustness  of  these  results 
must  be  addressed.  Most  notably,  the  choice  of  grade  cohort  combination  should  be 
examined.  It  is  important  to  determine  if  these  results  are  being  driven  by  the  choice  of 
cohorts  and  grades.  By  comparing  the  results  from  the  same  difference  in  difference  in 
difference  strategy  for  alternative  specifications,  the  robustness  of  the  results  can  be 
tested.  Table  2-6  compares  the  difference  in  difference  in  difference  estimate,  along  with 
standard  errors,  of  9  alternate  specifications.  Note  that  specification  1  is  the  same  as 
what  was  reported  in  Table  2-3.  Specification  1  can  be  used  as  a  benchmark  to  compare 
other  results.  In  five  of  the  alternative  specifications,  the  difference  in  difference  in 
difference  estimate  produced  the  same  sign,  although  of  weaker  magnitude.  For  the  three 
specifications  where  the  sign  was  not  as  expected,  those  estimates  were  not  statistically 
significant.  In  part,  this  pattern  is  due  to  the  choice  of  grade  transition,  for  example, 
using  a  grade  transition  from  second  to  third  will  not  provide  enough  variation,  and  from 
the  raw  data,  it  is  obvious  that  this  is  not  where  the  majority  of  the  transition  takes  place. 
For  example,  using  cohort  2,  as  in  specification  5,  does  not  provide  any  additional 
insight,  as  it  is  also  a  cohort  that  transitioned  before  the  policy  change.  As  expected, 
specification  1 ,  where  the  cohorts  and  grades  were  chosen  based  on  the  theory,  provides 
the  best  support  of  the  results. 


32 


2.4.1.4  Cost  categories 

Another  way  to  test  the  validity  of  the  results  is  to  divide  up  the  classification  by 
cost  categories.  For  example,  it  is  clear  that  some  disabilities  are  more  cost  intensive  to 
schools  than  others.  These  disabilities  require  excessive  funds  for  trained  professionals 
and  resources.  In  all  cases,  a  high  cost  disability  is  also  a  very  obvious  one.  Traumatic 
brain  injury  is  one  example  of  a  high  cost  disability  that  is  also  quite  obvious.  These 
children  should  not  be  affected  by  the  policy,  as  their  obvious  disability  would  allow 
them  to  receive  benefits  before  and  after  PRWORA,  provided  they  met  income  eligibility 
requirements.  On  the  other  hand,  specific  learning  disability  is  a  low  cost  category  that  is 
less  obvious.  Children  with  this  disability  would  more  likely  be  affected  by  the  policy. 
To  test  these  hypotheses,  disabilities  were  divided  into  high  and  low  cost.  Several 
models  were  estimated  using  individual,  district  and  a  combination  of  both  fixed  effects. 
The  results  in  Table  2-7  show  that  none  of  the  explanatory  variables  were  significant  in 
explaining  the  probability  of  being  classified  when  a  child  has  a  high  cost  disability. 
These  results  confirm  that  children  with  high  cost  disabilities  should  not  have  been 
affected  by  the  policy. 

As  a  comparison,  Table  2-8  demonstrates  that  the  effects  of  the  policy  on  the 
probability  of  being  identified  as  having  a  low  cost  disability  were  very  similar  to  those 
for  all  disabilities.  Using  student  fixed  effects,  districts  fixed  effects  and  a  combination 
of  both;  the  table  shows  that  the  results  are  almost  identical  to  those  in  Table  2-5.  The 
decrease  in  classification  ranged  from  .019  to  .023.  Both  tables  2-7  and  2-8  provide 
additional  evidence  to  support  the  results  found  in  the  original  analysis.  Furthermore,  the 
results  bolster  the  fact  the  change  in  parental  incentives  was  more  pertinent  to  those 
children  who  had  less  obvious  disabilities 
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2.4.1.5  Non-linear  regression 

Finally,  a  probit  analysis  was  performed  to  test  the  data  in  yet  another  method  of 
analysis.  In  order  to  compare  the  results,  the  same  grade  and  cohort  combination  was 
used.  Table  2-9  gives  the  results  of  the  non-linear  specification  after  the  coefficients 
have  been  corrected  for.  Without  any  fixed  effects,  it  is  expected  that  the  results  will  be 
similar  to  those  of  the  ordinary  least  squares  regression  without  fixed  effects.6  For  the 
interaction  term  of  interest,  COHORT*ELIGIBLE*SECOND,  a  slightly  higher 
coefficient  of -.028  is  found.  Thus,  the  policy  leads  to  a  19%  reduction  in  overall 
classification  of  disabled  children. 

From  all  of  the  analyses,  for  both  linear  and  non-linear  models,  it  can  be  concluded 
that  the  effect  of  the  policy  was  to  reduce  overall  classification  of  disabled  children  by  a 
range  of  11%  to  19%. 

2.5  Empirical  Analysis  for  Parental  Shopping 

Next,  this  chapter  will  attempt  to  determine  if  parental  gaming  exists.  In  this  case, 
gaming  refers  to  the  idea  that  parents  will  try  to  change  schools  or  districts  in  order  to  get 
their  child  classified  with  a  disability.  Meyer  (2000)  examines  the  extent  of  welfare- 
induced  migration  and  also  provides  a  brief  summary  of  empirical  articles  in  this  area. 
All  of  these  studies  attempt  to  estimate  the  migration  effects  prior  to  PRWORA.  He  finds 
that  the  literature  is  inconclusive  at  best.  Meyer  shows  that  much  of  the  inconsistency  in 
findings  is  in  methodology,  sample  selection,  and  comparison-group  approach.  Almost 
all  the  studies  are  performed  at  the  inter-state  level  completely  disregarding  within  state 
differences.  Results  from  these  studies  vary,  with  some  finding  no  significant  link 
between  migration  and  welfare,  and  others  finding  a  positive  and  significant  link  between 

6  No  analog  to  a  fixed  effects  model  using  probit  analysis  exists. 
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the  two.  Combining  both  structural  and  comparison  based  methodologies  Meyer  finds 
evidence  of  welfare-induced  migration.  However,  this  research  is  conducted  using  1980 
and  1990  census  data,  and  does  not  account  for  changes  in  welfare  due  to  PRWORA. 

This  analysis  is  one  of  the  first  to  investigate  the  link  between  PRWORA  and 
migration  at  an  inter-state  level.  Prior  to  PRWORA,  parents  could  more  easily  game  the 
system,  meaning  they  could  push  to  get  their  child  classified  even  if  it  were  not 
warranted.  After  PRWORA,  this  became  a  problem.  No  longer  were  children  classified 
on  the  opinions  of  parents  and  school  personnel,  but  medical  documentation  in  many 
cases  became  a  requirement.  How  did  this  affect  a  parent's  ability  to  game  the  system?  It 

4 

would  be  expected  that  a  stricter  criterion  would  cause  gaming  by  parents  to  fall.  To  test 

this  hypothesis  a  new  dependent  variable  was  constructed.  The  SWITCH  variable  is  a 

dummy  that  is  equal  to  1  when  a  child  changes  districts.  Therefore,  the  new  dependent 

variable  is  the  probability  that  a  child  switches  districts  to  gain  classification. 

Table  2-10  shows  the  results  of  five  specifications  using  only  the  children  that 

gained  classification.  Specification  1  regresses  the  following  equation: 

(3)        SWITCHj,  =  Ok  +  PELIGIBLE;,  +  yPRWORAit  + 
SELIGIBLEj,  *  PRWORAjt  +  Kit  +  u.it 

where  i  indicates  individual,  t  indicates  time  and  k  is  the  fixed  effects  parameter. 

The  variable  of  interest  is  8.  If  it  is  expected  that  parents  are  more  likely  to  lose 

their  ability  to  shop  due  to  the  tighter  restrictions,  then  8  should  be  negative.  From  the 

table  it  can  be  seen  that  the  sign  is  as  expected,  and  the  coefficient  is  significant.7 

Specification  2  adds  a  district  fixed  effect,  and  8  yields  the  correct  sign  and  is  significant. 

Next,  year  dummies  are  added  to  capture  any  time  trends  that  may  be  simultaneously 

7  Using  a  two-tailed  test. 


35 

occurring.8  Specification  3  again  produces  the  correct  sign  and  significance.  Likewise, 

specification  4,  which  includes  both  district  fixed  effects  and  year  dummies,  gives  similar 

results.  Finally,  the  non-linear  probit  model  is  used,  and  the  corrected  coefficients  are 

reported.  This  evidence  can  be  contrasted  with  a  similar  analysis  on  gaming  from 

changing  schools.  Results  showed  that  no  evidence  of  gaming  existed  from  changing 

schools,  therefore,  if  any  gaming  did  happen  it  was  at  the  district  level. 

Finally,  the  data  were  partitioned  into  children  who  did  and  did  not  switch  districts. 

Those  who  switched  districts  were  saved  as  the  sample,  and  those  who  did  not  were 

discarded.  A  new  dependent  variable  was  constructed  that  was  used  to  predict  the 

probability  that  a  child  gains  classification.  When  gaining  classification,  a  child  is  not 

classified  in  one  year  and  is  classified  the  subsequent  year.  The  new  equation  becomes: 

(4)        TRANSi,  -  a*  +  pELIGIBLEit  +  yPRWORAit  + 
8ELIGIBLEit  *  PRWORAit  +  Kit+  \mx 

where  i  indicates  individual,  t  indicates  time  and  k  is  the  fixed  effect  parameter. 

Table  2-1 1  gives  the  results  of  the  same  five  specifications  as  in  Table  2-10. 
Again,  in  four  of  the  five  cases  the  effect  of  the  policy  was  to  decrease  shopping, 
however,  most  of  these  were  not  statistically  significant. 

From  the  above  exercises  it  is  clear  that  a  negative  shopping  effect  does  exist  at  the 
district  level.  Although  the  interaction  variable  of  interest  was  not  significant  in  most 
cases,  the  signs  agree  in  all  specifications.  This  should  not  be  surprising  due  to  the  fact 
that  people  change  districts  for  a  variety  of  reasons  other  than  gaming.  Omitted  variable 
bias  exists  since  the  variables  in  this  data  cannot  control  for  all  the  factors  that  affect  a 


1992  and  1993  were  dropped  from  the  analysis 
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parent's  decision  to  change  districts.  It  can  be  concluded  that  a  negative  shopping  effect 
exists,  although  its  precise  estimate  is  questionable. 

2.6  Conclusion 

The  Personal  Responsibility  and  Work  Opportunity  Reconciliation  Act  was 
designed  to  reform  a  welfare  system  that  had  long  been  inefficient.  Most  Americans 
associated  welfare  reform  with  time  limits  and  the  abolishment  of  AFDC,  but  PRWORA 
was  much  more  complicated.  Changes  were  also  made  in  the  areas  of  child  support, 
childcare  and  SSI.  And  while  many  studies  have  attempted  to  determine  what  impact 
PRWORA  made,  none  have  done  so  concerning  the  changes  in  SSI.  This  is  surprising 
given  the  fact  that  disabled  children  make  a  huge  impact  on  public  school  systems  and 
government  programs. 

Studying  the  effects  of  PRWORA  would  not  be  complete  without  understanding 
the  legal  changes  for  disabled  children  that  have  occurred  in  the  past  thirty  years. 
Initially  disregarded  in  many  areas,  disable  children  have  become  the  subject  of 
numerous  legislation  changes.  Some  of  these  changes,  the  IDEA  law  in  particular,  led  to 
schools  with  greater  fiscal  incentives  to  classify  with  an  increase  in  classification  rates. 
In  addition,  changes  in  the  SSI  program,  due  to  PRWORA,  have  led  to  a  decrease  in 
parental  incentives  to  have  children  classified  as  disabled.  Evaluating  this  change  in  the 
incentive  mix  is  important  in  analyzing  the  external  effects  of  PRWORA. 

While  other  research  exists  on  children's  SSI  issues,  it  has  focused  on  legislation 
that  was  passed  prior  to  1996,  most  notably,  on  the  effect  of  the  Zebley  V.  Sullivan  case. 
In  addition,  other  studies  have  shown  that  school  incentives  caused  a  change  in 
classification,  but  no  study  has  even  considered  the  changes  in  parental  incentives.  By 
using  a  unique  and  rich  individual  level  data  set,  I  am  able  to  provide  evidence  on  the 
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effect  of  PRWORA  on  disability  classification  rates.  Controlling  for  various  factors,  and 
using  both  linear  and  non-linear  models,  I  show  that  the  probability  of  being  classified 
with  a  disability  for  children  fell  by  at  least  1 1%  as  a  result  of  the  legislation.  Further, 
when  individual  and  district  fixed  effects  are  included,  to  control  for  time  invariant 
characteristics,  the  results  again  show  that  the  probability  of  being  classified  fell  by 
12.66%. 

Furthermore,  this  chapter  tests  the  hypothesis  that  following  PRWORA,  parents 
were  not  able  to  change  districts  in  order  to  gain  disability  classification  for  their  child. 
Using  both  linear  and  non-linear  models,  along  with  district  fixed  effects  and  year 
dummies,  I  find  that  a  parent's  ability  to  change  districts  in  order  to  gain  classification  for 
their  child  was  decreased  after  PRWORA  was  enacted.  Results  suggest  that  as  the  policy 
made  enrollment  more  restrictive,  parents  were  less  able  to  circumvent  the  system. 
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Figure  2-1.  Percent  of  children  nationally  served  by  IDEA  over  time 
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Figure  2-2.  Percent  of  children  served  in  Florida  by  IDEA  over  time 
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Figure  2-4.  Cohort  1 :  percent  of  disabilities  over  time 
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Figure  2-5.  Cohort  2:  percent  of  disabilities  over  time 


Figure  2-6.  Cohort  3:  percent  of  disabilities  over  time 
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Table  2-1.  Number  of  students  served  under  IDEA 


Category 

1989-90 

1998-1999 

Percent  change 

Specific  learning  disabilities 

2,062,076 

2,817,148 

36.6 

Speech  and  language  impairments 

974,256 

1,074,548 

10.3 

Mental  retardation 

563,902 

611.076 

8.4 

Emotional  disturbance 

381,639 

463,262 

21.4 

Multiple  disabilities 

87.957 

107.763 

22.5 

Hearing  impairments 

57,906 

70.883 

22.4 

Orthopedic  impairments 

48,050 

69,495 

44.6 

Other  health  impairments 

52,733 

220,831 

318.7 

Visual  impairments 

22,866 

26.132 

14.3 

Autism 

NA 

53.576 

Deaf-blindness 

1,633 

1.609 

-1.5 

Traumatic  brain  injury 

NA 

12,933 

Developmental  delay 

NA 

11.910 

All  disabilities 

4,253,018 

5,541,166 

30.3 
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Table  2-2.  Summary  statistics 


Variable 

Mean  in  full 
sample 

Mean  in  reduced  sample 

ELIGIBLE 

co  Tin/ 

CO  T20X. 

Oo.ijyo 

/IT    A  f**  S~*  1  1  'T  1  *T"\ 

CLASSIFIED 

1  nrio/ 
lUU/o 

WHITE 

COHORT  1 

34.29% 

COHORT  2 

34.80% 

COHORT  3 

30.91% 

Percent  exceptional  in  cohort  1 

15.39% 

Percent  exceptional  in  cohort  2 

14.97% 

Percent  exceptional  in  cohort  3 

14.74% 

Number  of  observations  in  full  sample  =  1,038,676 
Number  of  observations  in  reduced  sample  =  156,956 
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Table  2-3.  Difference  in  difference  in  difference 


Dependent  variable 

CLASSIFIED 

Cohort  1 

Cohort  3 

Kindergarten 

Second 

Difference 

Kindergarten 

Second 

Difference 

Eligible 

0.104 

0.184 

0.08 

0  1 

0  179 

0  078 

(.305) 

{.388} 

(0.003) 

(.301) 

(  383) 

(0  003) 

Non  eligible 

0.081 

0.129 

0  047 

0  065 

0.135 

0  071 

{.273} 

{  335} 

(0  003) 

{  246} 

{  342} 

(0  003) 

Difference  in  difference 

0.032 
(0  004) 

0.007 
(0  004) 

Difference  in  difference  in  difference 

-0.025 
(0  005) 

Standard  errors  are  in  parenthesis  ( ). 
Standard  deviations  are  in  brackets  { } . 
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Table  2-4.  Ordinary  least  squares  regression  

Dependent  variable  CLASSIFIED 

Coefficient 

Variable  estimate 


-U.  U  1  / 

(0.002) 

ELIGIBLE 

*  SECOND 

0.033 

(0.003) 

COHORT 

*  SECOND 

0.024 

(0.004) 

COHORT 

*  ELIGIBLE 

0.013 

(0.003) 

COHORT 

*  ELIGIBLE*  SECOND 

-0.025 

(0.005) 

Standard  errors  are  in  parenthesis. 
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Table  2-5.  Ordinary  least  squares  regression  with  fixed  effects 


Dependant  variable 

CLASSIFIED  CLASSIFIED 

CLASSIFIED 

Specification 

1 

2 

3 

Fixed  effect 

Student 

District 

Student  & 
District 

Variable 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

ELIGIBLE 

0.0099 

0.034 

0.0044 

(0.0048) 

(0.0024) 

(0  0045) 

SECOND 

00501 

0  039 

0  044 

(0.0023) 

(0.0029) 

(0.0023) 

COHORT 

-0017 

-0.012 

-0.065 

(0.0022) 

(0.0023) 

(0.0590) 

ELIGIBLE  *  SECOND 

0026 

0  029 

0029 

(0.0033) 

(0.0040) 

(0.0031) 

COHORT  *  SECOND 

0.019 

0.027 

0.024 

(0.0030) 

(0  0040) 

(0.0031) 

COHORT*  ELIGIBLE 

0.0044 

0.012 

0.0078 

(0.0063) 

(0.0032) 

(0.0062) 

COHORT  *  ELIGIBLE  *  SECOND 

-0016 

-0.021 

-0.019 

(0.0042) 

(0.0055) 

(0.0041) 

Standard  errors  are  in  parenthesis 
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Table  2-6.  Sensitivity  checks 


Dependant  variable 

Specification 

Year  span 

Year  span  for 

Pre  grade 

Post 

Difference  in 

for  older 

younger  cohort 

grade 

difference  in 

cohort 

difference 

CLASSIFIED 

1 

92-94 

94-96 

Kindergarten 

2"1 

-0  025 
(0.005) 

CLASSIFIED 

2 

92-94 

94-96 

Kindergarten 

ft 

-0016 
(0.006) 

CLASSIFIED 

3 

92-94 

93-95 

Kindergarten 

2"d 

-0.011 
(0  004) 

CLASSIFIED 

4 

92-94 

93-95 

Kindergarten 

3* 

-0.009 
(0005) 

CLASSIFIED 

5 

93-95 

94-96 

2nd 

3n 

0  004 

(0.005) 

CLASSIFIED 

6 

92-94 

94-96 

2nd 

3* 

0  006 

(0.005) 

CLASSIFIED 

7 

92-94 

93-95 

2"1 

3ri 

-0.002 
(0.005) 

CLASSIFIED 

8 

93-95 

94-96 

Kindergarten 

2^ 

-0.003 
(0  004) 

CLASSIFIED 

9 

93-95 

94-96 

Kindergarten 

3ri 

0001 
(0.004) 

Standard  errors  are  in  parenthesis. 
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Table  2-1.  Regression  by  high  cost  category 


Specification 

1 

2 

3 

4 

Fixed  Effects 

No 

Student 

District 

Student  & 
District 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

ELIGIBLE 

0  0096 

0  00014 

0  00078 

000014 

(0  00052) 

(0.00082) 

(0  00055) 

(0.00079) 

COHORT 

-0.00027 

-0.0305 

-0  00022 

-0.0307 

(0  00053) 

(0  01050) 

(0.00052) 

(001050) 

SECOND 

0.00087 

0.00029 

0.00082 

0.00027 

(0.00061) 

(0.00048) 

(0.00063) 

(0.00041) 

ELIGIBLE  *  SECOND 

000093 

0.0013 

0.00099 

00013 

(0  00088) 

(0.00053) 

(0  00087) 

(0.00053) 

ELIGIBLE*  COHORT 

0  00095 

0  00078 

0  000073 

0  00071 

(0  00070) 

(0  00110) 

(0  00073) 

(0  00110) 

SECOND* COHORT 

0.00105 

0.0013 

0.00101 

0.0013 

(0  00082) 

(0  00062) 

(0  00086) 

(0  00055) 

ELIGIBLE*  SECOND* 

COHORT 

0  00035 

-0.00006 

-0.00045 

-0.000065 

(0.00120) 

(0  00073) 

(0.00120) 

(0.00073) 

Standard  errors  are  in  parenthesis 
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Table  2-8.  Regression  by  low  cost  category 


Dependant  variable 

LOW  COST 

LOW  COST 

LOW  COST 

LOW  COST 

DISABILITY 

DISABILITY 

DISABILITY 

DISABILITY 

Specification 

1 

2 

3 

4 

Fixed  Effect 

No 

Student 

District 

Student  & 

District 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

ELIGIBLE 

0019 

0.0043 

0.0033 

0.0043 

(0  0023) 

(0.0045) 

(0.0023) 

(0  0045) 

COHORT 

-0.0012 

-0.029 

-0.012 

-0.034 

(0  0022) 

(0  0590) 

(0.0022) 

(0  0590) 

SECOND 

0.044 

0  044 

0  039 

0  044 

(0.0029) 

(0.0023) 

(0.0029) 

(0.0023) 

ELIGIBLE  *  SECOND 

0.029 

0  027 

0.029 

0  027 

(0.00404) 

(0.00305) 

(0.00401) 

(0  00305) 

ELIGIBLE*  COHORT 

0.015 

0.00709 

0.012 

0.0068 

(0  0031) 

(0.0063) 

(0.0031) 

(0  0062) 

SECOND*  COHORT 

0.025 

0.023 

0.025 

0.023 

(0.0039) 

(0.0031) 

(0.0039) 

(0.0031) 

ELIGIBLE*  SECOND*  COHORT 

-0.023 

-0019 

-0.021 

-0.019 

(0  0055) 

(0.0044) 

(0.0054) 

(0.0041) 

Standard  errors  are  in  parenthesis. 


Table  2-9.  Probit  regression 


Dependant  variable 

CLASSIFIED 

Variable 

Coefficient 
estimate 

ELIGIBLE 

0.026 

(0.002) 

SECOND 

0.052 

(0.003) 

COHORT 

-0  024 
(0.003) 

ELIGIBLE  "SECOND 

0.02 
(0  004) 

COHORT*  SECOND 

0.032 

(0.005) 

COHORT*  ELIGIBLE 

0.021 
(0  004) 

COHORT*  ELIGIBLE  *  SECOND 

-0028 
(0.005) 

Standard  errors  are  in  parenthesis 
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Table  2-10.  Parental  shopping  effect  on  switching  districts 


Dependant  Variable 

SWITCH 

SWITCH 

SWITCH 

SWITCH 

SWITCH 

Specification 

1 

2 

3 

4 

5 

(Probit) 

Fixed  Effects 

No 

District 

Year 

District  & 
Year 

Year 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

estimate 

ELIGIBLE 

0.0095 

0.013 

0.0097 

0.013 

0  01002 

(0.0022) 

(0.0023) 

(0  0022) 

(0.0023) 

(0  0022) 

PRWORA 

0.0106 

0.0123 

0018 

0018 

0018 

(0.0026) 

(0.0027) 

(0  0047) 

(0.0047) 

(0.0048) 

ELIGIBLE*PRWORA 

-0013 

-00118 

-0014 

-0.012 

-0.0135 

(0.0033) 

(0.0033) 

(0.0033) 

(0.0034) 

(0  0029) 

1994 

— 

-- 

— 

— 

0  00206 

(0  0044) 

1995 

0.0042 

0.0022 

0  0068 

(0  0027) 

(0.0027) 

(0  0042) 

1996 

-0.0076 

-0.0073 

-0.0044 

(0  0039) 

(0.0038) 

(0  0025) 

1997 

-0.0049 

-00036 

-0.0021 

(0  0042) 

(0.0039) 

(0  0028) 

1998 

-0.0027 

0.0034 

(0.0083) 

(0.0043) 

Standard  errors  are  in  parenthesis 
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Table  2-11.  Parental  shopping  effect  on  gaining  classification 


Dependant  variable 

TRANS 

TRANS 

TRANS 

TRANS 

TRANS 

Specification 

1 

2 

3 

4 

5 

(Probit) 

Fixed  Effect 

No 

Year 

Year 

District 

District  & 

Year 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

estimate 

PRWORA 

-0.015 

-0  027 

— 

-00089 

0.0048 

(0.0033) 

(0  0068) 

(00061) 

(0.0077) 

ELIGIBLE 

0.013 

0.013 

0.0103 

0.027 

0.026 

(0  0037) 

(0  0037) 

(0  003002) 

(0  0072) 

(0.0072) 

PRWORA*  ELIGIBLE 

-0.0022 

-0.0018 

0.0017 

-0.021 

-0.019 

(0.0042) 

(0.0042) 

(00041) 

(0  0082) 

(0.0082) 

1992 

— 

— 

— 

— 

— 

1993 

— 

— 

0.037 

— 

0.017 

(0  0094) 

(0.01) 

1994 

-- 

-0.0097 

0  024 

— 

— 

(0  0065) 

(0.0061) 

1995 

-00026 

0  031 

-0.028 

(0  0063) 

(0  0059) 

(0.0075) 

1996 

0.017 

0.019 

0.00803 

(0  0029) 

(0  0039) 

(00056) 

1997 

0.84 

0.0103 

0.0109 

(0.0029) 

(0  0038) 

(0  0059) 

1998 

0.0012 

0  0013 

(0.0027) 

(0.0034) 

1999  -  -  -  -  -00079 

 (0.0051) 

Standard  errors  are  in  parenthesis. 


CHAPTER  3 

BIRTH  VITAL  STATISTICS  AND  THE  CLASSIFICATION  OF  DISABLED 
CHILDREN:  TO  USE  OR  NOT  TO  USE? 

3.1  Introduction 

When  President  Clinton  signed  welfare  reform,  or  PRWORA,  into  law,  disabled 
children  were  forced  to  meet  tougher  SSI  guidelines.  One  purpose  for  this  change  was 
the  belief  that  parents  were  coaching  their  children  to  meet  the  requirements  for  SSI 
benefits.  Following  PRWORA,  parental  incentives  no  longer  existed  due  to  the  stricter 
criteria.  No  other  study  has  sought  to  estimate  the  impact  of  this  change  in  incentives  on 
the  classification  of  disabled  children.  Previously,  in  this  dissertation,  research  was 
conducted  to  determine  this  effect.  Chapter  2  used  numerous  econometric  models, 
including  the  use  of  student  and  district  level  fixed  effects,  all  of  which  bolstered  the 
main  finding  that  classification  rates  decreased  after  the  policy  change.  In  addition, 
Chapter  2  addressed  the  issue  of  parental  shopping  for  a  new  school  district  in  order  to 
gain  classification  for  their  child.  However,  questions  concerning  the  result  on 
classification  still  exist.  Data  utilized  in  Chapter  2  were  from  only  21  districts  in  the  state 
of  Florida.  Due  to  migration  problems  outside  of  the  sample  area,  the  classification  result 
may  have  been  different  if  the  entire  state  were  used.  Specifically,  when  only  21  districts 
are  used  it  could  be  argued  that  children  moving  outside  the  sample  might  marginally 
affect  the  results.  If  enough  children  moved  outside  the  sample  area,  this  could 
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potentially  bias  the  results.  This  chapter  uses  data  from  the  entire  state  to  mitigate  those 
questions  about  migration. 

Another  goal  of  this  chapter  is  to  determine  if  the  results  suffer  from  omitted 
variable  bias.  In  particular,  the  literature  on  disability  suggests  that  birth  statistics  might 
be  imperative  in  predicting  disability.  For  instance,  the  literature  has  shown  that  children 
who  have  less  educated  mothers  are  more  likely  to  be  disabled.  In  Chapter  2,  mother's 
education  was  omitted  from  all  of  the  models.  Thus,  the  question  must  be  asked,  are  the 
results  robust  to  including  this  and  other  variables? 

Chapter  3  of  this  dissertation  uses  student  level  data  from  all  67  school  districts  in 
the  state  of  Florida.  There  are  distinct  advantages  and  disadvantages  to  using  this  volume 
of  data.  An  advantage  is  that  by  using  all  67  districts,  I  retain  information  on  each  child 
even  if  he  or  she  moves  within  the  state.  Unfortunately,  a  disadvantage  is  that  due  to  the 
enormous  amount  of  data,  utilizing  student  and  district  level  fixed  effects  is 
computationally  impossible.  Performing  similar  econometric  analysis,  sans  fixed  effects, 
corroborates  the  earlier  results.  Again,  it  is  found  that  following  PRWORA  fewer 
children  were  classified  as  disabled.  The  range  that  overall  classification  fell,  across  all 
specifications,  was  6.4  to  8.2%.  This  corroborates  the  previous  finding  that  classification 
rates  fell,  but  using  the  entire  state  reduces  the  magnitude  of  the  effect.  While  these 
results  cannot  be  directly  compared  to  those  from  Chapter  2,  since  they  do  not 
incorporate  fixed  effects,  they  do  provide  more  evidence  of  the  negative  effect  on 
classification  rates.  Lastly,  this  chapter  provides  evidence  that  the  omission  of  birth  vital 
statistics  does  not  change  the  primary  result.  Various  specifications  including  these 
variables  show  that  overall  classification  of  disabled  children  fell  from  7.05  to  9.4%. 


57 

Section  3.2.1  presents  the  background  of  the  pertinent  government  programs  and 
previous  research.  Next,  section  3.2.2  summarizes  the  existing  literature.  Section  3.3 
describes  the  data,  while  section  3.4  lays  out  the  empirical  analysis.  Finally,  section  3.5 
contains  the  conclusions. 

3.2  Background 

3.2.1  Legislative  Background 

The  Personal  Responsibility  and  Work  Opportunity  Reconciliation  Act,  signed  into 

law  on  August  22,  1996,  changed  the  mix  of  incentives  faced  by  parents  and  schools  to 
identify  disabled  children.  Disability  by  definition  now  required  that  a  child  have  a 
medically  determinable  physical  or  mental  impairment  or  combination  of  impairments 
that  causes  a  marked  and  severe  functional  limitation.  Children  who  previously  were 
placed  on  the  rolls  due  to  the  appeals  process  had  to  be  reevaluated  under  the  more  strict 
guidelines.  While  schools  still  had  an  incentive  to  "game"  the  system  and  miss-classify 
children  as  disabled,  parent's  ability  to  do  so  was  greatly  reduced. 

This  change  in  the  law  actually  affected  the  number  of  children  being  identified  as 
disabled.  The  existing  literature  on  this  issue  is  sparse,  focusing  on  changes  prior  to 
1996,  and  using  survey  or  aggregate  level  data.  For  example,  a  paper  by  Cullen  and 
Figlio  (1998)  related  to  the  IDEA  law  of  1990,  provided  evidence  that  increased  school 
fiscal  incentives  did  lead  to  significant  increases  in  the  number  of  children  classified  as 
disabled.  Using  school  and  district  level  data  from  the  SASS  survey,  the  paper  showed 
that  schools  were  more  likely  to  game  the  system  when  fiscal  incentives  were  greater. 
However,  prior  to  this  dissertation,  no  research  has  dealt  with  parental  incentives. 
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3.2.2  Existing  Literature 

Chapter  2  of  this  dissertation  used  a  unique  data  set  to  provide  initial  evidence  of 
the  change  in  parental  incentives  due  to  PRWORA.  Using  individual  education  statistics 
from  twenty-one  counties  in  the  state  of  Florida,  a  panel  of  data  was  constructed.  This 
panel  followed  three  cohorts  of  children  before  and  after  the  policy  change.  Using  linear 
and  non-linear  models,  some  with  student  level  fixed  effects,  the  results  demonstrated 
that  the  effect  of  the  policy  was  to  significantly  decrease  to  classification  of  disabled 
children.  It  is  important  to  note  that  while  all  models  were  in  agreement  to  the  direction 
of  the  effect,  the  magnitudes  were  slightly  different.  According  to  the  specific  empirical 
model  used,  the  overall  effect  of  the  policy  was  to  decrease  disability  labeling  by  1 1  to 
19%.  Various  sensitivity  tests  provided  additional  support  to  the  initial  findings. 

This  chapter  extends  the  previous  results  in  two  ways.  First,  data  from  all  67 
districts  in  the  state  of  Florida  are  used,  as  opposed  to  the  21 -district  sample.  Two 
reasons  might  contribute  to  the  importance  of  this  additional  data.  First,  each  district 
might  have  their  own  specific  way  of  classifying  children.  By  increasing  the  sample  to 
the  entire  state  of  Florida,  these  intra-district  differences  can  be  captured  and  controlled 
for.  Also,  as  mentioned  previously,  when  the  21 -district  sample  is  used  the  results  may 
suffer  from  bias  due  to  a  migration  factor.  As  children  moved  from  one  district  to  the 
next  within  the  state,  those  who  moved  out  of  the  sample  area  might  have  been  lost  from 
the  study.  By  using  the  entire  population,  these  factors  are  mitigated.  Second,  this 
chapter  incorporates  additional  variables  to  control  for  other  factors  that  could  explain 
classification  of  disabled  children.  For  example,  birth  weight  has  been  correlated  to 
disability  status  among  children.  By  controlling  for  birth  weight  across  cohorts,  this  will 
capture  omitted  policy  changes  other  than  PRWORA  that  affected  the  cohorts 
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differentially.  Numerous  birth  vital  statistics  have  been  identified  in  the  literature  as 
possible  indicators  of  disability.  Included  among  these  are:  birth  weight,  mother's  age, 
mother's  education,  prenatal  care,  apgar  scores  and  race. 

Birth  weight  could  affect  disability  classification  due  to  the  fact  that  smaller  babies 
are  more  likely  to  have  health  problems  and  more  likely  to  be  disabled.  Studies  have 
shown  that  the  incidence  of  disability  and  poor  performance  is  higher  for  children  whose 
birth  weight  is  low.  This  is  true  because  of  the  link  between  low  birth  weight  and  a 
higher  incidence  of  disability.  Currie  and  Hyson  (1999)  found  that  low  birth  weight  has 
significant  long-term  affects  on  education.  They  used  data  from  Great  Britain  to  follow 
all  children  born  during  the  same  week  in  1958  until  they  were  33  years  old.  Their  study 
found  that  low  birth  weights  had  significant  negative  effects  on  health,  education,  and 
labor  market  outcomes.  These  studies  confirm  many  pediatric  studies  that  have  found 
that  low  birth  weight  children  are  subject  to  negative  outcomes  (Aylward  et  al.  1989  and 
Brooks-Gunn  and  Klebanov  1992).  Chaikind  and  Corman  (1998)  did  an  important 
economic  study  that  links  low  birth  weight  to  placement  in  special  education  classes. 
Child  Health  Supplement  of  the  National  Health  Interview  Survey  data  were  used  on 
7,733  children  to  find  the  effect  of  low  birth  weight  on  educational  outcomes.  Taking  a 
treatment  group,  children  who  were  born  weighing  less  than  2500  grams,  and  a  control 
group  holding  socio-economic  factors  constant,  they  compared  behavior  and  school 
performance  across  both  groups  of  children.  Chaikind  and  Corman  determined  that  low 
birth  weight  children  are  more  likely  to  be  enrolled  in  special  education  classes  than  their 
peers. 
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Maternal  age  might  have  an  effect  on  disability  classification  in  two  ways.  It  could 
be  the  case  that  younger  mothers  are  less  education  and  have  lower  incomes  on  average. 
This  link  between  income  and  disability  status  makes  mother's  age  a  potential 
explanatory  variable.  Older  mothers  on  the  other  hand  have  a  direct  link  to  disability. 
Older  mothers  are  more  likely  to  give  birth  to  children  with  physiological  problems. 
Many  papers  have  studied  the  affect  of  maternal  age  on  education,  health,  and  labor 
market  outcomes  (Bromers  and  Grogger  1994,  Furstenberg  1976,  Furstenberg  et  al.  1987 
and  Hofferth  1987).  Two  studies  have  specifically  related  a  mother's  age  to  her  child's 
school  success.  A  study  by  Kellam  et  al.  (1979)  investigates  the  relationship  between 
maternal  age  on  school  performance.  They  used  data  from  a  longitudinal  study  on  black 
families  in  urban  areas  of  Chicago.  In  the  sample  of  1,242  children,  over  200  were  born 
to  adolescent  mothers.  They  found  that  these  children  were  less  likely  to  perform  well  in 
school  during  the  first  grade.  Additionally,  a  study  by  Davis  and  Grossbard  (1979)  used 
the  Cycle  II HES  data  to  examine  this  relationship.  Data  were  collected  on  the  school 
performance  of  1,750  10  and  1 1 -year-olds.  Results  from  the  study  showed  that  children 
with  young  adolescent  mothers  had  lower  reading  scores  and  experienced  more  grade 
repetition  than  their  counterparts. 

It  is  widely  known  that  older  mothers  are  more  susceptible  to  having  children  with 
physiological  problems  such  as  Downs  syndrome.  Contrasting  the  previous  mentioned 
studies  on  maternal  age  to  Witwer  (1990)  is  very  interesting.  Although  no  evidence  on 
school  or  disability  outcomes  exists,  Witwer  attempted  to  determine  the  effects  of 
delayed  childbearing  on  child  outcomes.  Specifically,  the  model  sought  to  determine  the 
effects  of  mother's  age  on  health  outcomes.  It  is  widely  known  that  older  mothers  are 
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more  susceptible  to  having  children  with  Down  syndrome  for  example.  Witwer,  using 
pregnancy  data  on  3,917  women  that  delivered  in  a  New  York  hospital  between  1985  and 
1987,  found  that  infants  born  to  older  mothers  were  just  as  likely  to  have  normal  health 
outcomes.  In  the  most  relevant  economic  study,  Angrist  and  Lavy  (1996)  used  cross- 
section  data  from  the  October  1992  Current  Population  Survey  (CPS)  to  estimate  the 
effect  of  mother's  age  on  her  child's  disability  status.  The  October  CPS  is  unique 
because  it  included  a  set  of  questions  on  the  health  and  self-reported  disability  status  of 
children  ages  3-14  and  15-24.  An  ordinary  least  square  regression  showed  that  there  was 
no  significant  relationship  between  young  mothers  and  disability.  Further,  the  results 
showed  that  there  was  also  no  significant  relationship  between  older  mothers  and 
disability.  The  authors  did  point  out  that  the  use  of  self-reported  health  and  disability 
data  might  create  a  downward  bias  in  their  results.  The  aforementioned  studies  illustrate 
that  no  clear  conclusion  can  be  made  concerning  the  relationship  between  maternal  age 
and  child  performance. 

A  mother's  level  of  education  might  affect  disability  classification  since  more 
educated  mothers  could  diagnose  disabilities  more  readily  and  be  more  receptive  to 
medical  intervention.  Mother's  education  could  also  be  linked  to  disability  through  birth 
factors.  More  educated  mothers,  who  have  a  greater  knowledge  of  what  their  baby  needs, 
are  more  likely  to  give  birth  to  healthier  babies,  and  healthier  babies  are  less  likely  to  be 
disabled.  Rosenzweig  and  Wolpin  (1994)  conducted  the  seminal  study  on  the  affect  of 
mother's  education  on  a  child's  intellectual  achievement.  Longitudinal  data  from  the 
National  Longitudinal  Survey  of  Labor  Market  Experience  survey  were  used  to 
determine  the  relationship  between  mother's  education  and  her  child's  intellect.  The  most 
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important  feature  of  this  study  was  to  consider  women  who  had  a  child  and  then 
continued  their  education.  Additional  education  by  the  mother  led  to  an  increase  in 
subsequent  children's  scores  on  the  Peabody  Individual  Achievement  Test.  The 
implication  of  this  study  is  that  as  mothers  become  more  educated,  they  are  better  able  to 
influence  their  child's  educational  attainment. 

Although  no  economic  studies  exist  that  relate  prenatal  care  to  disability  status,  it 
could  still  be  a  potential  indicator  since  other  economic  studies  have  related  it  to  birth 
weight.  Mothers  that  seek  out  prenatal  care  are  more  likely  to  give  birth  to  healthier 
babies,  and  healthier  babies  are  less  likely  to  be  disabled.  Joyce  (1997)  found  that  when 
women  enrolled  in  a  government  prenatal  program  in  New  York,  mean  birth  weight 
increased.  His  sample  of  over  23,000  births  was  linked  to  women  enrolled  in  the  Prenatal 
Care  Assistance  Program  (PCAP).  This  association  with  PCAP  led  to  an  increase  in 
Women  Infant  and  Children  enrollment,  and  in  turn,  an  increase  of  35  grams  in  mean 
birth  weight.  This  can  be  compared  to  results  found  in  Warner  (1998).  Performing  race- 
specific  regressions,  Warner  found  that  while  exposing  black  mothers  to  prenatal  care 
increased  the  growth  of  their  babies,  the  same  was  not  true  for  whites.  Warner  concludes 
that  prenatal  care  produces  modest  increases  in  birth  weight. 

Another  possible  indicator  of  disability  could  be  apgar  scores.  After  a  child  is 
born,  the  attending  physician  notes  an  apgar  score  after  one  and  five  minutes.  An  apgar 
scores  is  a  number  between  0  and  10  that  indicates  the  overall  health  of  the  child.  High 
apgar  scores  are  indicators  of  above  average  health  of  an  infant.  Although  there  are  no 
economic  studies  that  link  apgar  scores  to  disability  status,  numerous  medical  studies 
exist  that  link  apgar  scores  to  health  outcomes.  For  example,  Herbst  and  Thorngren- 
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Jerneck  (2001)  studied  infants  born  in  Sweden  between  1988  and  1997.  Data  were 
collected  from  the  National  Hospital  Discharge  Registry  and  the  Swedish  Medical  Birth 
Registry.  Over  1  million  births  were  recorded  and  of  those  0.76%  had  five-minute  apgar 
scores  below  7.  One  result  showed  that  the  odds  ratio  for  these  children  to  be  mentally 
retarded  was  9.5  out  of  1,000  live  births. 

Finally,  race  might  also  be  a  relevant  indicator  of  disability  status.  If  race  can  be 
linked  to  income,  then  the  argument  that  children  born  into  low-income  families  are  more 
likely  to  be  disabled.  It  can  be  argued  that  minority  children  on  average  are  more  likely 
to  be  from  low-income  families.  Therefore,  it  should  be  true  that  minority  children  are 
more  likely  to  be  classified  as  disabled.  Numerous  studies  (Heller  et  al.  1982,  Mercer 
1973  and  Serwatka  et  al.  1989)  have  shown  that  the  number  of  African- Americans  in 
special  education  classrooms  is  disproportionately  higher  than  their  counterparts. 
Anderson  and  Harry  (1994)  focused  on  the  effect  of  placing  African- American  students 
in  special  education  classrooms.  They  argued  that  the  process  of  placing  children  into 
special  education  settings  is  biased  for  African-American  children.  Using  data  from  the 
Office  of  Civil  Rights  1992  survey,  they  showed  that  African-Americans  are  over- 
represented  in  special  education  programs.  In  addition,  the  National  Longitudinal 
Transition  Study  of  Special  Education  Students  was  taken  during  the  1985-86  school 
year.  Using  information  from  this  study,  the  authors  found  that  among  secondary  school 
aged  children  African-Americans  were  twice  as  likely  to  be  identified  as  whites  were. 
Also,  the  study  found  that  African- American  males  were  more  classified  than  females. 
Likewise,  Deering  et  al.  (1995)  used  data  from  58  districts  in  the  state  of  Florida  to  show 
that  African-Americans  were  over-represented  in  special  education  classes.  They  found 
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that  African-Americans  were  over-represented  by  10%  with  a  standard  deviation  of  0.15. 
Interestingly,  the  study  showed  that  as  the  population  of  African-Americans  increased, 
the  overrepresentation  decreased. 

3.3  Description  of  Data 

In  order  to  analyze  the  effect  of  PRWORA  on  disability  classification,  individual 
level  data  including  both  birth  vital  and  education  statistics  are  needed  for  a  time  period 
that  spans  before  and  after  the  passage  of  the  bill.  In  this  chapter,  data  from  all  67 
districts  in  the  state  of  Florida  are  utilized.  Education  statistics  for  every  child  in  the 
public  school  system  who  entered  kindergarten  in  the  state  were  gathered  starting  in 
1992.  The  collected  data  were  then  matched  to  individual  level  birth  vital  statistics  by 
identification  code,  name,  sex,  race  and  birth  date.  These  data  were  collected  each  year 
until  the  1999-2000  school  year.  Children  in  these  data  were  divided  into  cohorts 
according  to  the  year  in  which  they  began  kindergarten.  Three  cohorts  were  available, 
with  entering  years  of  1992-1993,  1993-1994  and  1994-1995.  These  will  be  referred  to 
as  cohort  1,  2  and  3,  with  cohort  1  from  1992-1993  being  the  oldest  group.  Cohort  1 
consists  of  34.5%  of  the  total  population,  while  cohorts  2  and  3  count  for  34.6%  and 
30.8%.  Overall,  we  have  three  cohorts  of  children,  data  on  each  child  for  at  most  eight 
years,  resulting  in  a  data  set  with  almost  two  million  observations  as  contrasted  to  the  one 
million  observations  in  Chapter  2. 

This  individual  data  set  is  the  largest  one  available  that  matches  the  birth  vital  and 
education  statistics  needed  for  the  analysis.  Using  the  summary  statistics  for  the  data  in 
Table  3-1  as  a  reference,  we  see  that  in  the  entire  population,  17%,  or  over  322,000,  are 
classified  with  an  exceptionality.  This  is  slightly  larger  than  the  15%  figure  from  the  21- 
district  sample  in  Chapter  2.  It  should  be  especially  noted  that  although  gifted  is  another 


65 


type  of  exceptionality  classification,  those  children  are  not  considered  in  this  analysis. 
Grouping  all  three  cohorts  together,  we  can  describe  some  additional  traits  of  the 
population.  In  the  population,  56.21%  of  the  children  are  within  185%  of  the  poverty  line 
and  thus  qualify  for  free  and/or  reduced  lunch,  and  57.78%  are  white,  where  white  does 
not  include  children  of  Hispanic  origin.  These  statistics  are  slightly  lower  than  in  the  21- 
district  sample.  Mean  age  of  the  mother  at  time  of  delivery  is  25.64  with  a  standard 
deviation  of  5.69  years.  Over  71.80%  of  the  mothers  had  at  least  a  high  school  education. 
At  least  96.86%  of  the  mothers  said  they  had  some  type  of  prenatal  care.  The  average 
birth  weight  of  children  in  the  population  was  7.3 1  pounds.  Mean  apgar  scores  at  one 
and  five  minutes  were  8. 19  and  9.04  respectively,  where  10  is  the  highest  possible  score. 
As  in  the  previous  research,  qualifying  for  free  and/or  reduced  lunch  will  serve  as  a  proxy 
for  meeting  the  income  eligibility  requirement  for  SSI. 

Also  shown  in  Table  3-1  are  the  characteristics  of  the  population  classified  as 
having  an  exceptionality.  This  group  in  many  ways  differs  from  the  general  population. 
The  group  had  a  much  higher  percent,  68%,  of  children  who  are  income  eligible.  This 
was  identical  to  the  percentage  in  the  21 -district  sample.  Mother's  age  is  comparable  to 
that  in  the  general  population  at  25  years,  with  a  standard  deviation  of  5.7  years.  The 
percent  of  mothers  who  had  prenatal  care  drops  slightly  to  95%,  as  does  the  percent  of 
the  sample  that  are  white.  As  expected,  birth  weight,  apgar  score  after  1  minute,  and 
apgar  score  after  5  minutes  are  lower.  Likewise,  the  percent  of  mothers  with  a  high 
school  degree  falls  to  63%,  and  percent  eligible  for  free  or  reduced  lunch  rises  to  51%. 
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3.4  Empirical  Analysis 
3.4.1  Difference  in  Difference  in  Difference 

First,  to  evaluate  the  effect  of  using  the  entire  67-  district  population  as  opposed  to 
the  21 -district  sample,  an  identical  difference  in  difference  methodology  is  used  as  in 
Chapter  2.  In  order  to  make  the  general  interpretations  more  clear,  I  will  briefly 
summarize  the  methodology. 

The  dependent  variable  of  interest  is  the  probability  between  0  and  1  that  a  child  is 
identified  as  disabled.  Independent  variables  used  to  explain  this  probability  include  an 
income  eligibility  indicator,  a  grade  indicator,  and  a  policy  indicator.  The  income 
eligibility  indicator  was  used  as  a  criterion  that  affects  the  classification  of  disability. 
This  criterion  is  needed  to  control  for  the  fact  that  the  policy  will  create  differential 
incentives  for  parents  who  are  income  eligible.  A  grade  indicator  was  constructed  to 
control  for  the  increase  in  classification  of  disabled  children  as  they  make  the  transition 
from  kindergarten  to  second  grade.  All  other  grades  are  dropped  from  the  sample. 
Because  the  indicator  equals  1  when  the  child  is  in  second  grade,  and  0  for  kindergarten, 
an  increase  in  classification  over  grade  transition  is  expected.  Again,  this  expected 
change  in  classification  is  not  due  to  the  policy,  so  it  must  be  controlled  for. 

After  both  grade  transition  and  income  eligibility  are  controlled  for,  treatment  and 
control  groups  are  set  up  to  determine  the  effect  of  the  policy.  As  in  Chapter  2,  this  is 
accomplished  by  exploiting  the  three  cohorts.  Cohort  1,  which  is  the  oldest,  started 
school  in  the  1992-1993  calendar  year.  These  children  were  in  the  fourth  grade  when  the 
policy  change  took  place  in  1996.  Therefore,  the  expected  change  from  kindergarten  to 
second  grade  had  already  occurred.  As  a  direct  comparison,  cohort  3,  the  youngest 
group,  started  kindergarten  prior  to  PRWORA,  and  entered  second  grade  after  the  policy 
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change.  From  this,  two  groups  emerge.  The  control  group,  unaffected  by  the  policy, 
consists  of  the  older  cohort  as  they  transition  from  kindergarten  to  second  grade,  taking 
their  poverty  status  into  account.  Comparatively,  the  treatment  group,  affected  by  the 
policy,  consists  of  the  younger  cohort  as  they  transition  form  kindergarten  to  second 
grade,  taking  their  poverty  status  into  account. 

Table  3-2,  shows  the  difference  in  difference  in  difference  results.  Dealing  with 
cohort  1  only,  the  control  group,  the  first  cell  shows  that  0.1231  is  the  mean  probability  of 
being  identified  as  having  a  disability  for  kindergarteners  in  poverty.  The  analogous 
probability  of  being  identified  as  having  a  disability  for  second  graders  in  poverty  is 
0.202.  The  first  cell  in  row  two  reports  that  .084  is  the  mean  probability  of  being 
identified  as  having  a  disability  for  kindergarteners  not  in  poverty.  Finally,  the  mean 
probability  of  being  identified  as  having  a  disability  for  second  graders  not  in  poverty  is 
.133.  The  third  cell  in  row  one  shows  that,  for  all  children  who  are  in  the  control  group 
and  are  impoverished,  the  difference  between  the  two  mean  probabilities  of  being 
identified  is  .079.  It  should  be  noted,  that  to  obtain  the  correct  standard  errors  for  this 
estimate,  a  simple  regression  was  performed.2  We  expect  that  the  difference  between 
kindergarteners  and  second  graders  will  be  larger  than  the  same  difference  for  the  non- 
poverty  group  since  this  is  for  children  in  poverty.  In  fact,  this  is  what  occurs  as  seen  in 
the  cell  directly  below  it,  where  the  difference  in  means  is  .048.  Finally,  the  difference  in 


1  Standard  deviations  are  presented  in  Table  3-2 

2  The  regression  used  is  CLASSIFIEDit=  ctit+  pSECONDit  +  yELIGIBLEj, 
+CELIGIBLEit*SECONDit+ 
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kindergarteners  and  second  graders  probabilities  by  poverty  status  is  taken  for  the  control 
group.  For  cohort  1,  the  difference  in  difference  is  .030  with  a  standard  error  of  .003. 

As  compared  to  the  parallel  control  group  from  Chapter  2,  the  results  are  strikingly 
similar.  The  difference  in  difference  for  cohort  1  was  .032,  which  indicates  that  the 
sample  was  an  adequate  representation  of  the  population  for  the  older  group  of  children. 

Next,  the  same  analysis  is  done  for  the  treatment  group,  or  the  group  that  was 
affected  by  the  policy.  The  first  cell  shows  that  0. 127  is  the  mean  probability  of  being 
identified  as  having  a  disability  for  kindergarteners  in  poverty.  Like  in  the  case  of  cohort 
1,  it  is  expected  that  the  next  cell  will  be  greater  in  magnitude  as  we  take  the  transition  of 
grades  into  account.  Since  .209  is  the  mean  probability  of  being  identified  as  having  a 
disability  for  second  graders  in  poverty,  the  expectation  is  met.  In  row  two,  .080  is  the 
mean  probability  of  being  identified  as  having  a  disability  for  kindergarteners  not  in 
poverty.  Finally,  .145  is  the  mean  probability  of  being  identified  as  having  a  disability 
for  second  graders  not  in  poverty,  which  is  greater  due  to  the  grade  transition.  As  in 
cohort  1,  the  third  cell  in  row  one  shows  that  for  all  children  who  are  in  the  control  group 
and  are  impoverished,  the  difference  between  the  two  mean  probabilities  of  being 
identified  is  .082.  This  magnitude  should  be  greater  than  its  counterpart  from  cohort  1 
due  to  the  additional  effect  of  the  policy,  and  it  is.  The  third  cell  in  row  two  shows  that 
for  all  children  who  are  in  the  control  group  and  are  not  impoverished,  the  difference 
between  the  two  mean  probabilities  of  being  identified  is  .066,  lower  than  the  poverty 
group.  Finally,  the  difference  in  kindergarteners  and  second  graders  probabilities  by 
poverty  status  is  taken  for  the  control  group.  For  cohort  1,  the  difference  in  difference  is 
.017  with  a  standard  error  of  .003. 
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By  comparing  these  difference  in  difference  results  to  those  found  in  Chapter  2,  it 
becomes  clear  that  the  results  are  not  always  similar.  For  instance,  in  the  21 -district 
sample  from  Chapter  2,  the  difference  in  difference  for  the  treatment  group  was  0.007. 
When  the  magnitudes  of  these  differences  are  compared,  it  is  clear  that  the  difference 
from  the  21 -district  sample  is  smaller. 

Finally,  the  difference  in  difference  in  difference  is  taken  to  isolate  the  policy 
effect.  In  order  to  obtain  the  correct  standard  error,  a  regression  must  be  performed. 

The  equation  used  becomes: 

(1)      CLASSIFIED^  =  ait  +  pSECONDit+  yELIGIBLEit  +  5COHORTit  + 
eELIGIBLEi,  *  COHORT,  +CELIGIBLEit*SECONDit  +  qCOHORTj,  * 
SECONDit  +  ©ELIGIBLEi,  *  COHORT*  *  SECONDit+nit 

where  i  indicates  person,  and  t  indicates  time. 

The  difference  in  difference  in  difference  cell  from  Table  3-2  represents  an  estimate 

of  the  0  in  the  above  equation.  The  estimate  -.014  represents  the  difference  between 

kindergarten  and  second  graders  in  the  difference  between  impoverished  and  non-poverty 

children  in  the  difference  between  the  older  and  younger  group  of  children,  holding  all 

other  characteristics  constant.  This  is  in  agreement  with  the  expectation  that  as  parents  in 

poverty  lost  the  incentive  to  identify  their  children,  they  behaved  more  like  non-poverty 

parents  before  PRWORA,  controlling  for  the  grade  transition.  Classification  of  disabled 

children  fell  by  .014  due  to  PRWORA.  Since  17%  of  the  population  is  classified  as 

disabled,  this  means  that  the  overall  effect  of  PRWORA  was  to  decrease  classification  by 

8.2%. 

The  results  in  the  entire  67-district  population  corroborate  those  from  the  21 -district 
sample  fund  in  Chapter  2.  In  both  cases,  PRWORA  led  to  a  significant  reduction  in 
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overall  classification  of  disabled  children.  However,  the  magnitude  of  this  effect  was 
smaller  in  the  67-district  population.  That  the  control  groups  were  similar  in  both  cases 
indicates  that  this  might  not  be  due  to  the  21 -district  sample  being  unrepresentative  of  the 
population.  It  may  be  the  case  that  the  additional  counties  considered  implemented  the 
policy  change  differently,  and  being  unable  to  control  for  district  level  fixed  effects  has 
reduced  the  magnitude.  Also,  the  migration  effect  that  was  unaccounted  for  in  Chapter  2 
may  be  responsible  for  the  difference  in  magnitudes. 
3.4.2  Partialling  Out  the  Birth  Vital  Statistics 

Second,  I  consider  the  individual  birth  vital  statistics  that  may  have  affected  a 
child's  disability  status.  Each  child  has  specific  individual  characteristics  at  birth  that 
may  make  him  or  her  more  or  less  likely  to  be  classified.  To  account  for  these 
characteristics,  these  individual  birth  vital  statistics  need  to  be  held  constant.  By  holding 
these  variables  constant,  it  is  possible  to  isolate  each  individual's  response  to  the  policy 
regardless  of  these  effects.  Using  the  same  dependent  variable  CLASSIFIED  as  above, 
residuals  were  generated  from  partialling  out  the  effect  of  the  individual  birth  vital 
statistics.  The  equation  to  construct  the  residuals  becomes: 

(2)      CLASSIFIED^  ait  +  kMOM  AGEit  +  vPRENATAL  CARE*  + 
oWHITEit  +  TtBIRTH  WEIGHTj,  +  pAPGAR-  1  MINUTE*  +  tAPGAR-  5 
MINUTES;,  +  <;MOM  EDUCATION-  HS+it  +  \xlt 

where  i  indicates  person  and  t  indicates  time. 

Residuals,  uu,  for  each  observation  were  saved  as  the  new  variable  CLASSIFIED 
RESIDUAL.  Next,  these  retained  residuals  were  used  in  the  same  methodology  as  the 
difference  in  difference  in  difference  from  the  first  specification. 

Table  3-3  gives  the  results.  Again,  in  the  first  row  the  means  and  standard 
deviations  are  reported  noting  that  these  are  the  means  of  the  residuals.  As  in  the  first 


71 


specification,  it  is  expected  that  these  difference  in  difference  coefficients  will  be 
positive.  This  indicates  that  classification  increases  over  time  more  for  the  income 
eligible  group  than  the  ineligible.  As  seen  in  Table  3-3  the  predicted  signs  did  arise,  as 
did  the  increase  over  grade  transition  for  each  group.  Finally,  a  regression  is  performed 
so  that  the  correct  standard  errors  can  be  reported.  The  equation  becomes: 

(3)  CLASSIFIED  RESIDUALit  =  <xit  +  pSECOND*  +  yELIGIBLE*  + 
5COHORTit  +  £*  ELIGIBLE*  *  COHORT*  +CELIGIBLE**SECOND*  + 
nCOHORT*  *  SECOND*  +  ©ELIGIBLE*  *  COHORT*  *  SECOND*  +u* 

where  i  indicates  person  and  t  indicates  time. 

For  this  specification  the  estimate  for  0  is  -.01 1  with  a  standard  error  of  .004.  The 

estimate  shows  that  PRWORA  caused  the  classification  of  disabled  children  to  fall  by 

.011.  Again,  since  17%  of  the  population  is  classified  as  disabled,  this  means  that  the 

overall  effect  was  to  decrease  classification  by  6.4%.  Controlling  for  these  additional 

factors  has  reduced  the  magnitude  of  the  effect,  but  it  has  remained  significantly 

negative. 

3.4.3  Ordinary  Least  Squares  Model 

The  average  effect  of  the  birth  vital  variables  on  disability  classification  should  also 
be  estimated  for  the  population.  By  examining  the  average  effects  in  this  context  the 
results  can  be  compared  to  those  found  in  the  literature.  An  ordinary  least  squares 
regression  was  performed  using  the  same  combination  of  cohort  and  grade.  The 
following  equation  was  used: 

(4)  CLASSIFIED*=  a*  +  pSECOND*  +  yELIGIBLE*  +  5COHORT*  + 
eELIGIBLE*  *  COHORT*  +£ELIGIBLE**  SECOND*  +  nCOHORT*  * 
SECOND*  +  9ELIGIBLE*  *  COHORT*  *  SECOND*  +  kMOM  AGE*  + 
IMOM  AGE* 2  +  vPRENATAL  CARE*  +  oWHITE*  +  tiBIRTH 
WEIGHT*  +  pAPGAR-  1  MINUTE*  +  xAPGAR-  5  MINUTES*  +  qMOM 
EDUCATION-  HS+*  +  p.* 
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Table  3-4  reports  the  results  of  this  regression.  As  previously  mentioned,  the  signs 
on  the  poverty  and  the  second  grade  dummy  are  expected  to  be  positive.  Here,  they  have 
the  correct  sign,  and  are  statistically  significant.  The  cohort  dummy,  while  correct  in 
sign,  is  not  significant.  However,  when  interacted  with  other  variables,  the  cohort 
dummy  performs  as  expected.  In  particular,  the  interaction  between  cohort,  poverty,  and 
second  grade  dummies  has  a  similar  sign,  and  magnitude,  to  the  difference  in  difference 
in  difference  coefficient  from  the  previous  results.  Again,  the  estimate  -.012  represents 
the  difference  between  kindergarten  and  second  graders  in  the  difference  between 
impoverished  and  non-poverty  children  in  the  difference  between  the  older  and  younger 
group  of  children.  Interpretation  of  this  says  that  the  average  overall  effect  of  PRWORA 
was  to  decrease  classification  by  7.05%. 

Next,  the  affect  of  the  individual  birth  vital  statistics  must  be  evaluated.  Most  of 
the  estimated  coefficients  are  significant  and  corroborate  the  existing  literature.  The  sign 
of  the  birth  weight  coefficient  is  in  agreement  with  the  prediction:  as  children  are  born  at 
higher  weights,  they  are  less  likely  to  be  disabled.  Mothers  who  received  prenatal  care 
were  significantly  less  likely  to  have  a  disabled  child.  Children  with  higher  apgar  scores 
after  one  and  five  minutes  are  less  likely  to  be  identified  as  disabled.  Mothers  that  have 
at  least  a  high  school  education  are  less  likely  to  have  a  child  identified  as  disabled.  The 
coefficient  on  the  race  indicator  might  seem  unexpected.  Theory  has  linked  race  to 
disability  through  income.  While  previous  studies  suggest  that  white  children  are  less 
likely  to  be  disabled,  the  results  are  contradictory.  Inconsistent  estimates  may  imply  that 
race  is  not  a  good  proxy  for  income. 
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Finally,  according  to  the  literature,  very  young  and  possibly  very  old  mothers 
should  have  a  higher  probability  of  having  a  disabled  child.  Since  a  non-linear  effect  is 
expected,  both  mother's  age  and  mother's  age  squared  are  included  in  the  regression. 
The  results  do  not  confirm  this  pattern  of  disability.  Taking  the  derivate  of  the  equation 
with  respect  to  mother's  age  yields  the  following: 

d  CLASSIFIED/  d  MOM  AGE  =  .002  -  .0006  (MOM  AGE) 

For  mothers  below  age  33.33,  the  equation  yields  a  positive  sign,  and  negative  for 
mothers  older  than  that  age.  Although  this  is  the  opposite  of  what  might  be  expected,  the 
results  in  the  literature  are  also  ambiguous  as  to  the  effect  of  maternal  age. 

Finally,  it  is  important  to  note  that  the  inclusion  of  the  birth  vital  statistics  did  not 
alter  the  results  for  the  effect  of  PRWORA  on  classification.  This  was  also  true  in  the 
results  from  partialling  out  the  individual  effects.  Therefore,  two  different  models 
indicate  that  the  inclusion  of  the  birth  vital  statistics  is  not  necessary  to  the  overall  results. 

There  are  a  few  reasons  why  the  above  ordinary  least  squares  specification  is 
biased.  To  be  more  precise,  the  combination  of  variables  may  cause  some  collinearity 
problems.  For  example,  theory  indicates  that  prenatal  care  is  directly  linked  to  birth 
weight  and  apgar  scores.  This  would  indicate  that  the  use  of  prenatal  care  and  birth 
weight  and  apgar  scores  in  the  same  regression  is  incorrect.  A  regression  that  includes 
prenatal  care  should  not  include  birth  weight  or  the  apgar  scores  and  visa  versa. 
Alternative  ordinary  least  squares  regressions  were  performed  to  find  the  correct 
identification  strategy.  Beyond  the  combination  of  variables,  the  mother's  age  variable 
did  not  yield  formidable  results  and  its  functional  form  might  be  incorrect.  The  quadratic 
form  of  maternal  age  is  not  significant  and  contrasts  results  found  in  some  previous 
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studies.  To  correct  the  functional  form,  the  quadratic  was  replaced  by  two  indicator 
variables  for  maternal  age.  One  dummy  variable,  YOUNG  MOM,  indicates  mothers 
aged  18  years  or  younger.  Older  mothers,  or  mothers  35  years  and  older,  are  indicated  by 
an  OLD  MOM  variable.  Separating  out  the  two  age  groups  allows  each  group  to  have  its 
own  effect  on  disability  status.  According  to  theory,  older  mothers  have  a  direct  link  to 
disability  while  younger  mothers  are  linked  to  disability  through  income.  Moreover,  it  is 
unclear  if  both  young  and  old  mothers  should  be  controlled  for  in  the  same  regression. 
Table  3-5  gives  the  ordinary  least  squares  results  from  various  specifications  using 
different  combinations  of  these  variables.  Initially,  it  should  be  noticed  that  across  all 
specifications,  the  policy  variable  is  consistent.  For  all  five  specifications  the  effect  of 
the  policy  was  to  decrease  classification  by  .012  to  .013,  which  is  in  agreement  with 
previous  estimates.  Again,  this  leads  to  the  conclusion  that  including  these  birth  vital 
statistics  does  not  alter  the  principle  result.  Specifications  2,  3,  5,  and  6  indicate  that  the 
indicator  for  older  mothers  should  not  be  included,  as  it  is  not  significant.  Therefore, 
specifications  1  and  4  are  both  candidates  for  the  "best"  model.  These  two  specifications 
vary  in  their  inclusion  of  the  prenatal  care  variable  versus  including  birth  weight  and 
apgar  score  variables.  Both  specifications  report  the  correct  signs  for  those  variables  and 
their  estimations  are  consistent.  Since  the  policy  variable  from  specification  1  and  4  is 
identical,  either  model  is  acceptable  to  use  when  determining  the  policy  effect.  Lastly,  it 
is  important  to  note  that  across  all  specifications  the  sign  for  young  mothers  is  negative. 
This  suggests  that  younger  mothers  are  less  likely  to  have  disabled  children.  Obviously, 
this  is  not  the  expected  sign.  Theory  suggests  that  young  mother  are  linked  to  disability 
through  income.  It  may  be  the  case  that  age  is  not  a  good  indicator  of  low-income.  In  all 
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of  the  specifications,  the  dummy  for  older  mothers  was  not  significant.  Older  mothers 
are  more  likely  to  be  associated  with  having  children  with  disabilities  such  as  Down's 
syndrome.  As  compared  to  the  more  marginal  disability,  such  as  specific  learning 
disorder  that  does  not  necessarily  manifest  itself  at  birth,  these  disabilities  prone  to  older 
mothers  are  not  driving  the  results.  Disabilities  such  as  Down's  syndrome  are  not  as 
likely  to  lead  to  gaming  possibilities  as  the  marginal  disabilities  would. 
3.4.4  Non-Linear  Models 

Finally,  the  hypothesis  is  tested  using  a  non-linear  econometric  methodology. 
Since  the  dependant  variable  is  an  indicator  variable  that  takes  on  a  0  or  1  value,  the 
results  should  be  checked  in  a  non-linear  model.  Two  probit  specifications  were  tested 
using  the  combination  of  variables  that  best  fit  the  theory.  Coefficient  estimates  were 
corrected  so  that  they  may  be  directly  compared  to  those  found  in  the  ordinary  least 
squares  models.  Results  in  Table  3-6  show  that  the  non-linear  specifications  yield  the 
almost  identical  results  as  the  linear  models.  Overall,  the  effect  of  the  policy  was  to 
decrease  the  probability  of  classification  9.4%.  Both  non-linear  models  provide  yet 
another  piece  of  evidence  that  including  the  birth  vital  statistics  does  not  change  the 
result. 

3.5  Conclusion 

This  chapter  is  a  second  attempt  at  quantifying  the  effect  of  PRWORA  on  the 
classification  rates  of  disabled  children.  Using  a  larger  data  set  of  67  school  districts,  I 
confirm  the  earlier  result  that  the  effect  of  PRWORA  was  to  significantly  decrease  the 
classification  of  disabled  children.  I  find  that  the  range  in  which  classification  fell  was 
between  6.4  and  9.4%.  Comparing  this  to  this  to  the  range  of  decrease  in  classification 
rates  found  in  Chapter  2,  1 1  to  19%,  these  estimations  are  significantly  lower.  There  are 
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two  possible  explanations  for  this  phenomenon.  First,  due  to  computational  limits, 
student  fixed  effects  were  not  used.  Omission  of  these  fixed  effects  may  have  caused  the 
estimated  coefficients  to  be  smaller.  Second,  it  may  be  the  case  that  when  the  21 -district 
sample  was  used,  children  who  migrated  out  of  the  sample  caused  the  results  to  be 
biased.  By  directly  comparing  the  results  in  this  chapter  to  those  found  previously,  it 
becomes  clear  that  even  though  the  magnitudes  are  not  exactly  identical,  another  piece  of 
evidence  exists  to  support  the  claim  that  PRWORA  decreased  classification  of  disabled 
children. 

Beyond  bolstering  previous  results,  this  chapter  also  attempted  to  determine  if  birth 
vital  statistics  were  imperative  in  explaining  classification  trends.  For  the  various 
specifications  that  included  these  variables,  it  was  clear  that  the  overall  results  were  not 
significantly  changed.  Across  all  linear  and  non-linear  models  that  took  the  birth  vital 
statistics  into  account,  the  effect  of  the  policy  was  still  found  to  be  significantly  negative 
on  classification.  Therefore,  it  can  be  concluded  that  further  analysis  on  classification 
and  welfare  effects  from  PRWORA  would  not  suffer  from  bias  if  the  birth  vital  statistics 
were  omitted. 

Chapters  two  and  three  of  this  dissertation  conclusively  showed  that  the  effect  of 
PRWORA  was  to  decrease  classification.  Now  the  welfare  implications  of  that  effect 
need  to  be  evaluated.  For  instance,  it  cannot  be  stated  whether  parental  gaming  is 
beneficial  or  detrimental  without  knowing  what  the  welfare  effects  from  that  gaming  are. 
To  draw  conclusions  on  the  value  of  PRWORA  in  regard  to  disabled  children,  a  reliable 
welfare  analysis  must  be  performed. 
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Table  3-1.  Summary  statistics 


Variable 

M can  in  full 

Standard 

Mean  in  reduced 

Standard 

sample 

deviation 

sample 

deviation 

ELIGIBLE 

56  21% 

67  96% 

CLASSIFIED 

17% 

100% 

MOM  AGE 

25.64 

5.69 

25.08 

5.74 

PRENATAL  CARE 

96  86% 

95  19% 

WHITE 

57.79% 

55.93% 

BIRTH  WEIGHT 

7.31 

1.32 

7.15 

1.47 

APGAR-  1  MINUTE 

82 

1.25 

8.04 

1.44 

APGAR-  5  MINUTES 

9.04 

0.72 

8.97 

0.85 

MOM  EDUCATION-  HS+ 

71.83% 

62  99% 

Number  of  observations  in  full  sample  =  1,914,985 
Number  of  observations  in  reduced  sample  =  322,643 
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Table  3-2.  Difference  in  difference  in  difference 


Dependent 

CLASSIFIED 

variable 

Cohort  1 

Cohort  3 

Kindergarten 

Second 

Difference 

Kindergarten 

Second 

Difference 

Eligible 

0  123 

0  202 

0.079 

0.127 

0209 

0  082 

(  329) 

(402) 

(0  002) 

(  333) 

(.407) 

(0  002) 

Non  eligible 

0  084 

0.133 

0.048 

0.08 

0.145 

0  066 

{278} 

{  339} 

(0.002) 

(.271) 

(.352) 

(0  080) 

Difference  in  difference 

0.03 

0017 

(0.003) 

(0  003) 

Difference  in  difference  in  difference 

-0.014 

(0  004) 

Standard  errors  are  in  parenthesis  ( ). 
Standard  deviations  are  in  brackets  { ) . 
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Table  3-3.  Partialling  out  residuals 


Dependent 

CLASSIFIED  RESIDUAL 

variable 

Cohort  1 

Cohort  3 

Kindergarten 

Second 

Difference 

Kindergarten 

Second 

Difference 

Eligible 

-0.032 

0.047 

0.079 

-0.033 

0.049 

0082 

{.325) 

{.399) 

(0.002) 

(  329) 

{.403) 

(0  002) 

Non- 

-0.029 

0.014 

0.044 

-0.033 

0.025 

0058 

ekgible 

(.277) 

{.339) 

(0.002) 

(.270) 

{.350) 

(0  08) 

Difference  in  difference 

0.035 

0  024 

(0.003) 

(0  003) 

Difference  in  difference  in  difference 

-0011 

(0.004) 

Standard  errors  are  in  parenthesis  (  ) 
Standard  deviations  are  in  brackets  { ) . 
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Table  3-4.  Ordinary  least  squares  regression 


Dependant  variable 

CLASSIFIED 

Variable 

Coefficient 

estimate 

ELIGIBLE 

0.012 

(0.003) 

SECOND 

0.044 

(0.002) 

COHORT 

-0  004 

(0.002) 

ELIGIBLE  *SECOND 

0  034 

(0  003) 

COHORT*SECOND 

0.015 

(0.003) 

COHORT*  ELIGIBLE 

0  004 

(0.003) 

COHORT*  ELIGIBLE  *SECOND 

-0012 

(0.004) 

MOM  AGE 

0.002 

(0.0008) 

MOM  AGE2 

-0.00003 

(0.00001) 

PRENATAL  CARE 

-0034 

(0.003) 

BIRTH  WEIGHT 

-0  009 

(0.0004) 

WHITE 

0.05 

(0.001) 

APGAR-  1  MINUTE 

-0.011 

(0  0006) 

APGAR-  5  MINUTES 

-0006 

(0.0009) 

MOM  EDUCATION-  HS+ 

-0  027 

(0.001) 

Standard  errors  are  in  parenthesis. 
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Table  3-5.  Ordinary  least  squares  regressions  corrected  for  collinearity 

Dependant  variable 

CLASSIFIED 

CLASSIFIED 

CLASSIFIED 

CLASSIFIED 

CLASSIFIED 

CLASSIFIED 

Specification 

1 

2 

J 

C 

J 

£ 

c 

v  anabie 

Coefficient 

L/Oemcient 

Coefficient 

Coefficient 

Coefficient 

v_oemcienc 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

T?T  TrTDT  17 

(\  f\AQ 
U.U4o 

ft  rvis 

u.u*to 

/A  ft/\>M\ 

(0.0021) 

(0.0021) 

/A  rtft^  1  \ 

(0.0021) 

/A  AAA,1\ 

(0.0021) 

/A  AA11\ 

(0.0021) 

/A  AAT1\ 

(0.0021) 

•MiUUxNlJ 

n  run 

U.lKt  / 

U  U"4  / 

(0.0022) 

(0  0022) 

/a  nrtiix 
(0.0022) 

/A  AAH\ 

(0.0022) 

/A  AAT">\ 

(0.0022) 

/A  rtfiTJV 

(0.0022) 

UUllUx\.x 

-  u .  u  u*+  ^ 

-U.  UU*+£ 

n  on<a^ 

-U.  KfvHJ 

0  004^ 

CO  00 1  HI 

CO  001 

IU.  UU  1  □  J 

CO  00 1 

CO  00181 

V  v.  U  U  I  O y 

CO  001  ffi 

^U.  UU  1 

ELIGIBLE  *SECOND 

0  0306 

0  0302 

0  0301 

0  0305 

0  0304 

0  0306 

m  oo3?i 

m  003?1 

f0  00351 

fO  00321 

CO  00321 

CO  00321 

COHORT*SECOND 

0.016 

0.016 

0  016 

0  016 

0  016 

0.016 

(0  nn31> 

^U.  UUJ  1 J 

«i  00311 

^U  UU  J£.J 

CO  00311 

cn  nrnu 

COHORT*  ELIGIBLE 

0  0079 

0.0077 

0.0076 

0  0079 

0  0079 

0  0081 

(0  0026) 

(0  0026) 

(0.0026) 

(0  0027) 

(0.0026) 

(0  0026) 

COHORT*  ELIGIBLE 

-0.013 

-0.012 

-0  012 

-0.013 

-0  013 

-0  013 

JI/'w  ^xN 

CO  00441 

fO  00441 

(0.0044) 

(0  00441 

CO  00441 

CO  00441 

XUUINLj  MUM 

-U.UUoJ 

-U.UUCO 

-U.UUo^ 

A  AAiTI 

(0  0021) 

(0  0021) 

(0  0021) 

(0.0021) 

(0  0021) 

U.LU  MUM 

U.UUto 

U  UZj 

U.UU2o 

U  o  51 

(0  0021) 

(0  0180) 

(0.0021) 

(0  0021) 

-U.  Un*t 

-U.Ujj 

-U.U44 

(U.UUJ  /) 

(U.UU3/J 

(U  UUi  /) 

BIRTH  WEIGHT 

Xh?XX\,  X  XX    TV  1  1,1  11  1  X 

-0  0097 
(0  0005) 

-0  0101 
(0  00047) 

-0  0101 
(0  00046) 

WHITE 

0.047 

0.049 

0.41 

0.49 

0.49 

0.046 

(0  0012) 

(0.0012) 

(0.0106) 

(0.012) 

(0.0120) 

(0.0012) 

APGAR- 1  MINUTE 

-0.011 
(0.00061) 

-0  0011 
(0  00060) 

-0  0011 
(0.0006) 

APGAR-  5  MINUTES 

-0  0052 
(0.0011) 

-0.0058 
(0.0011) 

-00058 
(0.0011) 

MOM  EDUCATION-  HS+ 

-0.032 

-0  0305 

-0.028 

-0.031 

-0  031 

-0.032 

(0  0015) 

(0.0015) 

(0  0014) 

(0  0015) 

(0.0015) 

(0  0015) 

Standard  errors  are  in  parenthesis 


Table  3-6.  Non-linear  models 


Dependant  variable 

CLASSIFIED 

CLASSIFIED 

Specification 

1 
1 

c 

Variable 

V  OA  I CA  U 1  C 

V  111 

Cnrffinrnt 

estimate 

estimate 

ELIGIBLE 

0  054 

0  053 

SECOND 

(0.0024) 
0.056 

(0  0024) 

0.057 

COHORT 

(0.0027) 
-0  0064 

(0.0026) 
-0  0061 

(0.0026) 

1*1  m>i 
U.  U  l*t 

(0  0026) 
u.u  w 

(0.0034) 

(0.0034) 

COHORT*  SECOND 

0.019 
(0.0038) 

0.0101 

0019 
(0.0037) 

COHORT*  ELIGIBLE 

00101 

(0.0034) 
-0.016 

(0.0034) 

COHORT*  ELIGIBLE 

-0.016 

•SECOND 
YOUNG  MOM 

(0.0043) 

(0.0043) 

-0.0047 

-0.0063 

(0.0019) 

(0.0018) 

OLD  MOM 

-0.042 
(0.0035) 

-0.0093 

WHITE 

0  044 

0.047 

APGAR-  1  MINUTE 

(0.0010) 

(0  0012) 
-0.0099 
(0.00052) 

APGAR-  5  MINUTES 

-0.0044 
(0  00093) 

MOM  EDUCATION-  HS+ 

-0.0306 

-0.029 

(0.0015) 

(0  0014) 

Standard  errors  are  in  parenthesis. 


CHAPTER 4 

DID  WELFARE  REFORM  HELP  OR  HURT  DISABLED  CHILDREN? 

4.1  Introduction 

In  the  previous  chapters  of  this  dissertation,  I  investigated  whether  PRWORA  had 
an  effect  on  classification  rates  of  disabled  children  in  the  public  school  system. 
Overwhelmingly,  it  was  concluded  that  the  effect  of  PRWORA  was  to  decrease  the 
probability  that  a  child  would  be  classified  as  having  a  disability.  This  raises  the  next 
logical  question  of  whether  this  reduction  in  disability  classification  was  potentially 
harmful  or  beneficial.  To  answer  this  question,  the  welfare  effects  of  the  policy  need  to 
be  measured.  Potentially,  society  could  have  welfare  gains  or  losses. 

Gains  may  have  occurred  if  the  policy's  intentions  with  regard  to  parental 
incentives  were  correct.  For  example,  the  policy  led  to  stricter  requirements  for  disabled 
children  to  qualify  for  in-kind  benefits.  These  stricter  criteria  were  based  on  the  belief 
that  parents  were  coaching  children  who  were  not  disabled  to  be  classified  as  disabled.  In 
the  public  school  system,  the  change  in  incentives  manifested  itself  in  changes  in  disabled 
classification  rates.  As  a  result  of  the  policy,  some  children  were  removed  from  special 
education  classification,  and  classified  as  regular  education  students.  Since  special 
education  is  more  costly,  removing  these  children  from  this  classification  is  less  costly  to 
society.  Also,  if  these  children  were  inappropriately  placed  into  special  education 
settings,  this  may  have  decreased  their  cognitive  skill  level.  If  a  child's  skill  level  was 
above  that  of  special  education,  yet  he  was  inappropriately  placed  there,  he  might  not  be 
academically  challenged.  Children  in  this  setting  may  have  not  been  pushed  to  extend 
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their  cognitive  skills.  These  children  no  longer  have  the  best  opportunity  to  increase  their 
skill  set.  Skills  would  become  underdeveloped  as  children  remain  in  a  setting  that  is 
inappropriate  for  their  potential.  Therefore,  placing  these  students  into  regular  education 
settings,  where  peers  who  are  performing  at  the  same  level  would  surround  them,  would 
increase  their  performance  as  the  level  of  instruction  is  better  matched  to  their  skill  level. 

On  the  other  hand,  PRWORA  may  have  been  detrimental  to  children  and  society. 
Suppose  that  policymakers  were  incorrect  in  their  suspicions  about  parental  coaching.  In 
this  case,  children  who  were  truly  disabled  were  wrongly  removed  from  special  education 
classification.  This  change  would  create  potential  welfare  losses  to  society.  Children  in 
this  situation  may  learn  less  when  they  are  placed  into  regular  settings.  Special  education 
classes  tend  to  have  a  small  teacher  student  ratio.  On  average  special  education  classes 
have  1 5  students  per  teacher  while  regular  education  classes  have  24  students  per  teacher 
(Holcutt  1996).  Special  education  teachers  more  often  have  advanced  degrees  and 
specialized  training  to  teach  these  students.  Holcutt  (1996)  also  points  out  that  special 
education  teachers  praise  students  more  often,  teach  at  a  slower  pace  and  tend  to  have  a 
wider  repertoire  for  dealing  with  disruptive  children  than  regular  education  teachers. 
When  children  are  inappropriately  removed  from  this  environment,  they  lose  these  and 
other  benefits  of  special  education.  In  addition  regular  education  students  may  suffer. 
Teachers  in  those  classrooms  may  have  to  spend  more  time  with  the  special  education 
students,  and  the  regular  students  are  hurt  because  of  this.  If  this  scenario  were  realistic, 
then  the  performance  levels  of  both  special  and  regular  education  students  would  fall. 

Measuring  the  welfare  effects  of  PRWORA  is  complicated.  Welfare  effects  are 
captured  in  the  matching  or  mismatching  of  disability  status  to  educational  setting.  Four 
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distinct  groups  of  children  could  have  differing  effects:  children  who  were  in  regular 
education  before  and  after  the  policy,  children  who  were  in  special  education  before  and 
after  the  policy,  children  who  were  in  regular  education  before  the  policy  and  then  placed 
in  special  education  after  the  policy,  and  the  group  of  most  interest,  children  enrolled  in 
special  education  before  the  policy  and  subsequently  removed.  Of  course  these  children 
are  of  most  interest  since  they  would  have  been  the  group  most  likely  to  have  been 
subject  to  misclassification.  Even  with  an  ideal  data  set,  disentangling  these  effects 
would  be  challenging.  Fortunately,  using  administrative  data  from  two  large  and  diverse 
school  districts  in  the  state  of  Florida  along  with  two  advanced  econometric  approaches,  I 
am  able  to  separate  the  different  effects  and  estimate  the  effects  of  PRWORA  on 
standardized  test  scores. 

Results  from  both  econometric  approaches  show  that  standardized  test  scores  for 
the  group  of  children  of  most  interest,  those  who  were  enrolled  in  special  education 
before  PRWORA  and  promptly  removed  following  the  policy,  saw  significant  increases 
in  their  math,  reading  and  combined  scores.  Income  eligible  children  in  the  group  that 
were  removed  from  special  education  after  the  policy  saw  an  increase  in  their  combined 
score  by  2.91  points.  Given  that  on  average  a  child  is  able  to  increase  their  score  by  2.4 
points  per  month  from  classroom  instruction,  this  result  indicates  that  following  the 
policy  scores  increased  by  over  one  month  of  instruction.  A  consensus  of  all  the  results 
suggests  that  welfare  gains  were  realized  following  PRWORA.  Whether  or  not  these 
were  definitely  attributed  to  PRWORA  cannot  be  determined  since  parental  coaching 
cannot  be  proven,  however,  the  results  do  provide  evidence  that  some  misclassification 
did  occur  prior  to  the  policy  change.. 
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The  remainder  of  the  chapter  is  organized  as  follows.  Section  4.2  presents  the 
background  and  summarizes  the  existing  literature.  Section  4.3  describes  the  data,  while 
section  4.4  lays  out  the  empirical  analysis.  Finally,  section  4.5  gives  the  conclusions. 

4.2  Background 
4.2.1  Florida's  Assessment  Standards 

Standardized  testing  of  students  in  the  state  of  Florida  began  in  the  1970s.  Students 
in  grades  3,  5,  8,  and  1 1  were  required  to  take  the  State  Student  Assessment  Test,  Part  II 
(SSAT-II)  in  1976,  as  the  result  of  a  new  statewide  accountability  system.  Provisions 
were  made  for  educable  mentally  handicapped  (EMH),  trainable  mentally  handicapped 
(TMH),  emotionally  handicapped,  specific  learning  disabled,  physically  impaired,  and 
hearing  impaired  students.  During  the  1980s,  various  changes  were  made  in  standards, 
score  requirements,  and  the  tests  themselves.  By  the  1990s,  districts  had  an  option  of 
administering  their  own  assessment  test  in  addition  to  the  state  mandated  test. 
Subsequently,  the  majority  of  school  districts  chose  to  add  another  test  to  their  calendars. 
Some  examples  of  tests  that  districts  chose  to  administer  are  the  Stanford  9  Achievement 
Test  (SAT-9),  the  Iowa  Test  of  Basic  skills,  and  the  California  Achievement  Test.  The 
SAT-9,  which  is  the  standardized  test  used  to  measure  student  achievement  in  this 
research,  consists  of  both  reading  and  math  sections.  There  are  two  versions  of  the  SAT- 
9,  test  four  and  test  eight.  Test  four  was  designed  to  be  given  to  children  in  grades  one 
through  four,  while  test  eight  can  be  given  to  students  in  grades  five  through  eight. 
Elementary  school  children,  who  are  the  focus  of  this  study,  took  test  four. 

Districts  that  chose  to  administer  the  SAT-9  also  had  to  consider  how  the  disabled 
student  population  would  be  assessed.  Florida  statute  229.57(7)  requires  that 
modifications  be  considered  for  any  student  with  a  current  Individual  Education  Plan 
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(IEP).  An  IEP  is  an  education  path  that  is  designed  for  each  child  at  several  meetings 
between  school  personnel  and  parents.  Included  in  each  IEP  is  an  assessment 
recommendation.  Exemption  decisions  require  schools  to  consult  each  child's  IEP.  Any 
child  who  is  exempt  from  testing  must  have  a  documented  rationale  in  their  IEP,  and 
efforts  must  be  made  to  give  that  child  an  alternative  assessment.  Alternative 
accommodations,  such  as  revised  format  and  flexible  setting,  are  made  whenever 
possible,  as  the  state  expects  every  public  school  student  to  take  standardized  tests. 
Although  the  determining  factors  on  whether  a  child  would  be  assessed  are  dependent  on 
that  child's  IEP,  generalizations  can  be  made  based  on  which  categories  of  disability  are 
most  likely  to  take  the  test. 

It  is  important  to  note  that  the  above  guidelines  for  making  exemption  decisions 
were  used  prior  to  1997.  Changes  to  those  guidelines  were  made  in  1997  as  a  result  of 
amendments  to  the  Individuals  with  Disabilities  Act.  These  amendments  called  for  major 
changes  in  the  IEP  process.  One  of  the  changes  was  for  states  to  make  any  necessary 
provisions  so  that  all  disabled  children  could  be  assessed.  This  change  was  motivated  by 
the  idea  that  all  children  have  the  potential  to  be  educated  in  a  regular  education 
environment  and  thus  be  held  to  the  same  standards  as  those  in  regular  education.  As  a 
result,  federal  law  pushed  for  all  disabled  students  to  be  included  in  statewide  assessment 
and  to  meet  statewide  standards.  As  a  result,  large  numbers  of  students  who  previously 
were  able  to  avoid  assessment  were  no  longer  able  to  do  so.  Each  state  was  responsible 
for  assimilating  the  1997  amendments  into  their  own  programs,  and  was  required  to 
collect  data  on  their  progress.  In  the  state  of  Florida,  all  disabled  students  were  required 
to  be  included  in  state-  wide  assessment,  or  an  alternative  assessment,  by  July  1,  2000. 
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Alternative  assessment  plans  must  be  proposed  for  any  student  who  could  physically  or 
mentally  not  take  the  statewide  tests.  Each  district,  under  the  general  guidelines  of  the 
state,  was  required  to  have  an  alternative  assessment  plan  to  test  these  students.  Florida's 
inclusion  plan  was  to  be  phased  in  by  the  2000  deadline.  An  important  aspect  of 
imposing  this  deadline  is  the  reaction  across  districts.  Some  districts  have  taken  more  of 
a  proactive  attitude  towards  meeting  the  deadline  than  others.  As  a  result,  the  inclusion 
of  disabled  children  into  assessment  has  been  incorporated  in  a  non-uniform  manner. 
4.2.2  Existing  Literature 

Chapter  1  of  this  dissertation  carefully  explained  the  current  state  of  the  welfare 
reform  literature.  Using  Blank  (2002)  as  a  benchmark,  it  is  clear  that  the  value  of  this 
dissertation  lies  is  its  contributions  to  the  nonexistent  study  on  the  next  generation  of 
welfare  recipients.  By  focusing  on  the  children  of  low-income  families,  and  studying  the 
outcomes  of  these  children,  a  better  evaluation  of  welfare  reform  can  be  performed. 
Since  this  chapter  attempts  to  answer  the  question  of  how  educational  outcomes  were 
changed  following  PRWORA,  it  is  useful  to  consult  additional  branches  of  economic 
literature  for  guidance. 

Beyond  the  welfare  reform  literature,  this  analysis  also  greatly  contributes  to  the 
literature  that  evaluates  the  performance  effects  of  special  education.  Although  this 
literature  is  vast  for  regular  education  students,  only  a  few  studies  have  focused 
specifically  on  the  outcomes  of  special  education  students.  The  best  example  is  a  study 
by  Hanushek  et  al.  (1998)  that  estimated  the  relationship  between  special  education 
classification  and  outcomes  for  those  children.  Data  from  the  Texas  Schools  Microdata 
Panel  (TSMP)  were  used  for  the  years  1993-1995.  By  separating  out  disability 
categories,  controlling  for  students  who  transition  in  and  out  of  special  education  and 
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using  fixed  effects,  they  found  that  one  year  in  special  education  resulted  in  an  increase  in 
math  scores  by  0.09  standard  deviations  and  0.04  in  reading  scores.  Although  the 
inclusion  rate  of  special  education  students  who  took  the  standardized  test  in  this  study 
was  only  30%,  it  still  renders  an  interesting  analysis  on  the  effect  of  special  education 
programs. 

Given  the  limited  number  of  studies  on  the  performance  effects  from  special 
education,  studying  those  of  regular  education  students  will  at  least  provide  some  insight 
as  to  what  an  appropriate  model  should  look  like  and  what  results  might  be  expected. 
Many  economic  studies  estimate  performance  effects  using  education  production 
function  models.  As  in  a  general  production  function  model,  these  link  outcomes  to 
various  inputs.  Examples  of  some  outcomes  measures  in  the  literature  are:  future 
earnings,  future  labor  market  participation,  test  scores,  retention  rates,  and  dropout  rates. 
School,  parent,  and  student  inputs  are  used  to  explain  a  student's  achievement.  Some 
examples  of  school  inputs  are  class  size  and  teacher  quality,  which  have  been  measured 
by  teacher  salaries  and  teacher's  education  level.  Of  course,  parental  and  student  inputs 
should  be  factored  in,  but  how  to  do  so  is  debatable.  For  instance,  a  student's  cognitive 
ability  is  hard  to  define,  and  even  harder  to  enumerate.  Previous  studies  have 
incorporated  past  performance  as  an  indicator  of  future  performance,  which  may  lead  to 
potentially  biased  results.  Parental  inputs  can  be  even  harder  to  capture.  Parents 
obviously  play  a  significant  role  in  their  child's  achievement  by  the  quantity  of  time  they 
spend  with  their  child  and  their  ability  to  transfer  their  own  knowledge  to  their  child,  but 
it  is  difficult  to  measure  the  quality  and  quantity  of  parental  time.  Past  studies,  without 
direct  evidence  on  the  amount  of  time  spent  with  their  child  or  their  ability  to  instruct 
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their  child,  have  used  proxy  measures,  such  as  parental  educational  attainment  or 
mother's  labor  force  participation,  to  control  for  parental  inputs.  These  imprecise 
measures  introduce  potential  sources  of  error,  but  at  least  address  parental  input.  All 
these  issues  have  resulted  in  the  estimation  of  many  structurally  different  education 
production  functions. 

Two  studies,  Hanushek  (1986)  and  Kenny  et  al.  (1999),  review  the  existing 
empirical  literature  to  try  and  evaluate  these  different  types  of  production  functions. 
Particularly,  they  attempt  to  reach  a  consensus  about  the  relationship  between  school 
inputs  and  student  outcomes.  Hanushek  analyses  the  results  from  147  regressions  in  33 
articles  and  finds  no  conclusive  results  to  link  increases  in  school  inputs  to  student 
outcomes.  However,  Kenny  et  al.  propose  that  this  conclusion  is  inaccurate  based  on  the 
overwhelming  misspecification  of  education  production  functions.  Reviewing  the  same 
papers  as  Hanushek,  plus  an  additional  18,  they  segregate  regressions  as  good  and  bad 
depending  on  whether  household  budget  constraint  measures,  such  as  income,  are 
included  along  with  parental  and  student  inputs.  Comparing  the  results  from  the  good 
and  bad  studies  leads  to  a  strikingly  different  conclusion.  Kenny  et  al.  find  that  68.8%  of 
the  coefficients  yield  a  significant  and  positive  result,  suggesting  that  school  inputs  have 
a  direct  effect  on  student  performance.  Furthermore,  they  find  that  various  teacher 
characteristics,  class  size  and  per  pupil  expenditure  have  a  positive  impact  on  outcomes. 
This  larger  and  more  current  review  of  the  education  production  function  literature 
indicates  that  misspecification  has  led  to  the  misconception  that  the  returns  to  inputs  are 
slightly  significant  at  best. 
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Chapters  two  and  three  of  this  dissertation  demonstrated  that  PRWORA  had  a 
negative  affect  on  disability  classification.  Given  this  evidence,  I  now  ask  if  that  effect 
was  beneficial  or  detrimental  to  disabled  children.  To  answer  this  question,  I  use 
administration,  individual  level  data  from  two  districts  in  the  state  of  Florida  in  a  variety 
of  econometric  models.  Before  the  models  are  presented,  it  is  important  to  understand 
how  the  data  are  constructed. 

4.3  Description  of  Data 

To  investigate  the  effects  of  PRWORA  on  disabled  student  outcomes,  individual 
level  data  on  education  statistics  and  standardized  test  scores  are  needed  for  a  time  period 
that  spans  before  and  after  the  passage  of  the  bill.  To  meet  these  requirements,  data  from 
two  public  school  districts  in  the  state  of  Florida  are  used.  Data  collection  began  in  the 
1994-1995  school  year  for  all  children  in  first  through  fourth  grades.  Education  statistics, 
such  as  race,  free  or  reduced  lunch  status,  disability  status  and  grade,  for  every  child  in 
the  public  school  system  from  those  two  districts  were  gathered.  Next,  an  identification 
number  matched  the  education  statistics  to  each  child's  scores  on  the  SAT-9.  These  data 
were  collected  until  the  1999-2000  school  year.  In  both  districts,  students  were  required 
to  take  the  SAT-9  annually  from  first  to  fourth  grade.  Both  districts  in  the  sample  are  not 
only  large  but  also  demographically  diverse  in  their  populations. 

Summary  statistics  for  the  entire  sample  are  found  in  Table  4-1.  Across  both 
districts,  60.39%  of  the  children  are  within  185%  of  the  poverty  line  and  qualify  for  free 
and/or  reduced  lunch.  As  in  the  previous  chapters,  this  will  be  used  as  a  proxy  for  SSI 
eligibility.  In  the  sample  8.20%,  are  classified  with  an  exceptionality.  Comparing  this 
figure  with  that  from  chapters  2  and  3  might  lead  to  a  false  conclusion  that  on  average 
fewer  children  were  classified  as  disabled  in  these  two  districts.  However,  this  decrease 
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in  the  number  of  classified  children  is  a  result  of  using  only  those  disabled  students  who 
took  the  test.  Only  74%  did  so.  The  disabled  students  who  took  the  test  make  up  8.20% 
of  the  sample..  Although  the  1997  IDEA  Amendments  were  designed  to  prevent  this 
incidence  of  low  inclusion  by  requiring  that  all  disabled  students  be  included  in  statewide 
assessment  by  July  2000,  this  study  uses  data  prior  to  2000.  Inclusion  rates  lower  than 
100%  may  cause  selectivity  problems.  The  inclusion  rate  for  the  remaining  sample  is 
100%  after  reducing  the  sample.  Admittedly,  this  does  not  correct  the  selectivity 
problem  which  will  be  address  by  adding  student  fixed  effects  to  the  empirical  model. 

It  is  important  to  realize  that  the  remaining  8.20%  mean  disability  rate  is  quite 
different  from  historical  disability  rates  for  these  two  districts.  Figure  4-1  plots  the  mean 
classification  rates  of  these  two  districts  from  1996  to  2000.  Classification  rates  range 
from  9.8  to  1 1 .4%.  Clearly,  the  average  classification  rate  of  8.02%  in  this  sample  is 
smaller.  However,  using  this  reduced  sample  should  not  introduce  selectivity  bias  into 
the  research,  since  the  distribution  of  disabilities  is  similar  to  those  from  the  previous 
studies.  Table  4-2  lists  by  category  the  percent  of  disabled  students  who  took  the  test  and 
are  in  the  sample.  For  example,  97%  of  the  disabled  students  diagnosed  with  specific 
learning  disability  took  the  standardized  test.  Across  most  categories,  the  percentages  are 
very  high.  The  two  categories  that  were  included  in  the  reduced  sample  in  the  least 
percentages  were  homebound  and  traumatic  brain  injury. 1 


1  It  should  be  noted  that  the  exact  academic  setting  for  classified  students  is  not  know. 
For  example,  a  child  with  specific  learning  disorder  may  still  be  placed  in  a  regular 
classroom  setting.  However,  since  the  focus  of  this  paper  is  on  misclassification  and  the 
effect  of  financial  effectiveness,  it  should  also  be  noted  that  these  children  still  invoke 
special  education  funding  in  addition  to  the  allotted  per  pupil  expenditure. 
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Mean  math  score  in  the  entire  sample  is  592.45  points.2  Math  scores  range  from 
344  to  885  points,  with  a  standard  deviation  of  62.94  points.  Reading  scores  are  586.26 
on  average.  These  scores  fall  between  346  and  835,  with  the  standard  deviation  being 
54.65  points.  Mean  SAT-9  score  across  all  individuals  in  the  sample  is  1 178.71  with  a 
standard  deviation  of  1 13.62  points.  Figure  4-2  follows  the  mean  math  and  scores  over 
time.  The  trend  indicates  that  both  the  mean  reading  and  math  scores  have  increased  over 
time.  Beyond  level  test  scores,  it  is  also  an  interesting  exercise  to  get  an  idea  of  the 
average  percentage  of  students  who  passed  the  exam.  To  do  so,  students  who  scored  in 
the  52nd  percentile  in  reading  and  the  53rd  percentile  in  math  were  considered  passing.3 
Over  the  whole  sample,  48.15%  of  the  students  passed  the  reading  component  of  the 
SAT-9, 45.56%  passed  the  math,  while  46.59%  passed  both  sections. 

Also  shown  in  Table  4-1  are  the  summary  statistics  for  children  classified  as  having 
an  exceptionality.  This  group  differs  in  that  62.35%  are  income  eligible,  which  is  slightly 
higher  than  in  the  whole  sample.  As  expected,  the  math  and  reading  scores  for  this  group 
are  lower,  by  an  average  of  25  points.  Mean  reading  and  math  scores  are  563.26  and 
565.71  respectively.  The  range  for  reading  scores  is  346  to  81 1,  with  a  standard 
deviation  of  43.17  points.  Likewise,  the  range  of  math  scores  is  345  to  835,  with  a 
standard  deviation  of  50.96  points.  Mean  SAT-9  score  was  1 129.26  with  a  standard 
deviation  of  120.35  points.  Figure  4-3  plots  the  mean  math  scores  for  disabled  students 
over  time.  Although  the  mean  scores  are  lower  every  year  than  in  the  general  population, 

2  Due  to  concerns  of  measurement  error,  the  99th  and  1st  percentile  of  reading  and  math 
scores  were  dropped  from  the  sample. 

3  These  percentiles  were  chosen  from  comparable  passing  rates  on  a  similar  standardized 
test  in  the  same  year. 
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they  show  slight  improvements  in  almost  each  year.  Reading  scores  increase  every  year 
except  1999,  as  do  average  math  scores.  The  percent  of  students  passing  the  SAT-9  for 
these  students  is  much  lower  for  disabled  students.  For  these  students,  21.84%  passed  the 
reading  component,  23.32%  passed  the  math  and  21.57%  passed  both  sections. 

4.4  Empirical  Analysis 
An  ideal  education  production  function  would  control  for  school,  parent  and 
student  inputs.  Unfortunately,  the  data  used  in  this  research  do  not  allow  for  the  ideal 
production  function  to  be  used.  Therefore,  different  combinations  of  student,  school  and 
grade  fixed  effects  are  used  in  the  various  models.  For  example,  to  control  for 
differences  in  ability  across  students  and  in  school  and  parental  inputs,  I  use  student  fixed 
effects.  Alternatively,  in  some  models  I  use  census  level  variables  to  account  for  parental 
quality  and  quantity  of  time  spent  with  children.  Lastly,  school  fixed  effects  are  used  to 
capture  average  differences  in  students,  parents  and  school  inputs  across  schools  that 
would  affect  student  performance.  Different  models  are  estimated  that  account  for 
different  combinations  of  inputs.  For  instance,  one  model  uses  student  fixed  effects 
along  with  the  census  variables  to  control  for  differences  in  parental  and  student  inputs. 
These  strategies  are  used  in  conjunction  with  two  empirical  approaches:  the  reduced  form 
model  and  the  comparison  group  model. 

4.4.1  Reduced  Form  Model 

Welfare  effects  from  this  policy  may  have  been  positive  or  negative  to  society.  If 
resources  were  being  used  in  a  less  than  efficient  manner,  then  society  was  not  on  its 
production  possibilities  frontier.  Inefficiency  leads  to  loss,  and  society  suffers  because  of 
it.  Consider  a  child  who  has  a  disability,  and  following  PRWORA,  is  removed  from 


special  education  and  placed  into  a  regular  education  setting.  Outcomes  for  this  child 
after  removal  from  special  education  should  be  sub  par,  as  he  is  not  receiving  the 
appropriate  education  inputs  from  the  school.  Test  scores  for  a  child  in  this  circumstance 
might  fall,  and  the  child  may  even  be  retained  for  a  grade.  In  addition,  losses  may  also  be 
seen  for  the  regular  education  students.  Teachers  have  a  fixed  amount  of  time  that  must 
be  allocated  over  a  set  of  students.  When  a  disabled  child  is  introduced  into  that 
environment,  increasing  the  amount  of  time  spent  with  that  child  causes  the  remaining 
children  to  lose  part  of  their  time  allocation,  resulting  in  lower  test  scores. 

To  estimate  the  welfare  effects  of  PRWORA  it  is  important  to  separate  out  the 
effect  that  occurred  for  the  group  that  was  targeted  by  the  policy.  In  particular,  this  group 
consists  of  those  children  who  were  removed  from  special  education  following  the 
policy.  Isolating  the  direct  effects  on  this  group  is  complex.  Models  developed  to  get  at 
these  welfare  effects  are  not  perfect,  but  represent  a  starting  point  for  investigation. 

Estimating  the  overall  welfare  effects  starts  with  developing  a  model  that  tries  to 
control  for  the  applicable  inputs.  To  estimate  these  effects,  I  used  a  reduced  form  model. 
This  reduced  form  model  estimates  two  equations:  one  that  predicts  classification  and  one 
that  predicts  test  scores.  The  reduced  form  model  consists  of  two  equations: 

( 1 )  CLASSIFIED*  =  aELIGIBLEit  +  pPRWORAit  +  yGRADEit  + 
CGRADEit*ELIGIBLEit  +  r|ELIGIBLEit*PRWORAit  + 
0PRWORAjt*GRADEjt  +  8PRWORAit*GRADEit*ELIGIBLEi,.  +  uit. 

(2)  MATHit  =  ^CLASSIFIED*  +  iit  +  xit  +  xu  +  eit 

where  i  is  individual,  t  is  year,  and  i,  x,  and  %  are  fixed  effects  parameters  representing 

parent,  student  and  school  fixed  effects  respectively. 

Equation  (1)  was  developed  in  chapters  2  and  3  to  estimate  the  effect  of  PRWORA 
on  classification  rates.  The  ELIGIBLE  indicator  was  used  to  isolate  trends  in 
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classification  due  to  income  effects.  Past  literature  has  shown,  and  it  was  corroborated 
earlier  in  this  dissertation,  that  children  from  low-income  families  are  more  likely  to  be 
disabled.  Also,  it  takes  more  time  for  children  with  less  obvious  disabilities  to  become 
classified.  So,  as  children  transition  from  lower  to  higher  grades,  classification  rates 
increase.  Data  from  first  through  fourth  grades  are  used  in  this  study.  The  variable 
GRADE  captures  this  transition  from  first  to  third  grade.  Comparing  mean  classification 
rates  by  grade  showed  that  the  greatest  increase  in  classification  was  over  these  grades. 
After  third  grade  the  rate  of  classification  becomes  relatively  stable.  Lastly,  PR WORA, 
the  policy  indicator,  was  used  to  capture  effects  on  classification  that  took  place 
following  the  policy.  Chapters  2  and  3  used  the  interaction  variable, 
PR WORAit*ELIGIBLEit*GRADEit,  to  measure  the  differential  impact  that  the  policy  had 
on  impoverished  children  as  they  transitioned  from  lower  to  higher  grades.  In  all  cases 
the  estimated  coefficient  on  this  interaction  variable  was  negative  and  statistically 
significant. 

Equation  (2)  uses  classification  status,  parental,  student  and  school  inputs  to  predict 

a  student's  math  score.4  The  variable  STUDENT  represents  student  ability  and  effort, 

while  SCHOOL  captures  school  inputs.  The  variable  PARENT  is  a  vector  that  controls 

for  parental  inputs.  To  solve  the  reduced  form  model,  equation  (1)  is  substituted  into 

equation  (2)  and  results  in  the  following  model 

(3)      MATHi,  =  rELIGIBLEit  +  APRWORAit  +  0GRADEit  + 
AGRADEit*ELIGIBLEit  +  vFELIGIBLEit*PRWORAit  + 
EPRWORAjt*GRADEit  +  IPRWORAit*GRADEit*ELKjIBLEjt.  +  iit  +  xit 
+  X+Qlt. 


4  Reading  and  combined  scores,  denoted  SAT-9,  were  also  used  as  dependant  variables. 
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It  is  important  to  note  that  I  represents  the  estimated  effect  of  PRWORA  on  math 
scores  and  is  the  product  of  5  and  %.  The  sign  of  6  has  already  been  determined  to  be 
negative,  so  the  sign  of  n  will  determine  the  effect  of  PRWORA  on  math  scores.  If  n  is 
positive  that  means  that  following  PRWORA,  as  students  were  removed  from  special 
education,  their  test  scores  fell.  This  phenomena  would  be  true  since  I,  being  the  product 
of  a  negative  and  positive  sign,  would  be  negative  and  would  imply  that  a  welfare  loss 
was  realized.  On  the  other  hand  if  n  were  negative,  one  could  conclude  that  after 
PRWORA  declassified  children  saw  a  gain  in  their  test  scores.  This  would  be  the  case 
since  I,  the  product  of  two  negative  signs,  would  be  positive  and  would  imply  that 
welfare  gains  were  realized. 

A  variety  of  specifications  were  estimated  using  this  basic  reduced  form  model. 
From  these  results,  the  variable  of  interest  in  determining  the  policy  effect  is 
PRWORAjt*GRADEit*ELIGIBLEjt.  A  positive  value  for  the  coefficient  £  implies  that 
the  differential  effect  for  impoverished  children  following  PRWORA  led  to  higher  math 
scores.  Table  4-3  gives  the  initial  results  of  the  reduced  form  model. 

Specification  1  estimates  the  reduced  form  model  with  grade  fixed  effects  and 
controls  for  income  eligibility  and  race.  No  other  fixed  effects  are  used,  and  the  model  is 
estimating  using  the  entire  population  of  students.  The  estimated  positive  coefficient  on 
ELIGIBLE*PRWORA*GRADE  suggests  that  following  PRWORA,  impoverished 
children  scored  2.85  points  better  on  the  math  section  of  the  SAT-9,  controlling  for  grade 
transition.  The  positive  and  significant  result  suggests  that  PRWORA  led  to  welfare 
gains.  Following  PRWORA,  some  children  were  re-matched  to  their  educational  setting 
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by  disability  status.  If  this  new  match  were  a  more  appropriate  one,  then  test  scores 
would  have  risen.  The  initial  evidence  seems  to  indicate  this  was  the  case. 

Results  from  specification  1  also  show  that  black  children  significantly  scored 
18.46  points  less.  To  calculate  the  effect  of  income  eligibility  the  following  derivative  is 
evaluated:  dMATH/dELIGIBLE  =  -19.91  -10.32GRADE  +2.85GRADE*PRWORA.  To 
determine  the  effect  following  the  policy  and  after  grade  transition,  the  derivative  is 
evaluated  at  GRADE=1  and  PRWORA=l.  Calculating  the  total  effect  of  income 
eligibility  for  these  values  yields  dMATH/dELIGIBLE  =  -27.38.  Overall,  after  the  policy 
and  after  grade  transition,  math  scores  were  27  points  lower  for  income  eligible  children. 
These  negative  and  significant  results  agree  with  those  in  the  literature.  Also  as  expected, 
the  grade  transition  variable  captures  the  normal  increase  in  knowledge  across  grades. 
After  taking  the  derivative  dMATH/dGRADE  and  evaluating  it  for  income  eligible 
children  after  PRWORA,  of  transitioning  to  a  higher  grade  increases  math  scores  by 
69.64  points.  This  result  is  both  positive  and  significant  as  expected. 

Upon  further  investigation,  however,  these  results  are  clearly  misleading  for  two 
reasons.  It  is  clear  the  policy  should  have  affected  classified  and  not  classified  children 
in  different  ways.  To  account  for  this,  specifications  2  and  3  separate  out  these  students. 
The  triple  interaction  term  in  specification  2  indicates  that  PRWORA  led  to  an  increase  in 
math  scores  by  an  average  of  2.78  points  for  those  children  who  were  not  classified  after 
PRWORA.  Specification  3  reports  that  children  who  were  still  classified  after  PRWORA 
were  not  significantly  affected  by  the  policy.  This  is  expected,  since  children  still 
classified  as  disabled  after  PRWORA  are  not  the  group  that  represent  the  change  in 
welfare  effects  from  being  not  classified  after  the  policy.  Other  explanatory  variables, 
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such  as  BLACK,  ELIGIBLE  and  GRADE,  yield  significant  results  and  their  derivatives 
have  the  expected  signs. 

Next,  specifications  4,  5  and  6  incorporate  the  PARENTiti  SCHOOL*  and 
STUDENT^  variables.  To  control  for  differences  in  ability  across  students,  parental  time 
and  school  inputs  as  they  affect  an  individual  student,  student  fixed  effects  are  included 
in  the  model.  Again,  the  sign  on  the  triple  interaction  term  suggests  that  the  policy 
caused  an  increase  in  math  scores  across  all  students,  as  well  as  those  not  classified,  from 
2.23  to  2.40  points.  Students  still  classified  following  PRWORA,  in  specification  6,  did 
not  show  a  significant  policy  effect  in  the  triple  interaction  term  of  interest.  In  addition, 
the  derivative  with  respect  to  ELIGIBLE  in  specifications  4,  5  and  6  yields  the  expected 
sign.  Introducing  student  fixed  effects  obviously  increases  the  explanatory  power  as  the 
adjusted  R  values  dramatically  rise. 

Finally,  specifications  7,  8  and  9  incorporate  school  fixed  effects  into  the  reduced 
form  model.  School  fixed  effects  are  capturing  the  average  school  wide  effects  of  parent, 
student  and  school  inputs.  If  parents  of  similar  preferences  Tiebout  sort  into  the  same 
area,  then  school  fixed  effects  could  be  picking  up  differences  in  these  average  parental 
inputs  across  schools.  The  fixed  effects  also  capture  average  student  ability  and  average 
school  inputs.  Results  across  the  whole  population  and  for  the  not  classified  children 
corroborate  earlier  results  that  controlled  from  student  level  fixed  effects.  When  school 
fixed  effects  are  included,  the  policy  led  to  an  increase  in  math  scores  by  2.65  for  the 
entire  sample,  and  2.71  for  the  not  classified  students.  Specifications  3,  6  and  9  imply 
that  there  was  no  significant  change  in  math  scores  for  classified  students  following 
PRWORA.  Given  this  evidence,  the  not  classified  students  seem  to  be  the  only  group 
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that  was  affected  by  the  policy  as  expected.  This  implies  that  PRWORA  led  to  welfare 
gains  for  students  who  were  not  classified  after  PRWORA.  This  suggests  that  some 
students  who  were  not  classified  after  the  policy  may  have  become  better  matched  to 
their  educational  setting.  Table  4-4  gives  the  results  for  the  specifications  with  reading 
and  SAT-95  score  as  the  dependant  variable.  Across  all  reading  specifications  the  results 
suggest  that  PRWORA  led  to  gains  in  reading  scores.  Likewise,  all  specifications 
indicate  that  PRWORA  led  to  significant  gains  in  SAT-9  scores  from  5.47  to  14.1  points. 

Next,  a  different  dependant  variable  is  used.  To  make  more  general  conclusions,  a 
variable  was  constructed  to  indicate  whether  a  child  passed  the  math  portion  of  the  SAT- 
9.  This  new  dependant  dummy  variable,  PASS  MATH,  takes  on  a  1  if  the  student  scored 
above  passing  on  the  math  section,  and  a  0  otherwise.  All  the  reduced  form  regressions 
were  performed  again  using  this  new  dependant  variable.  Specifications  1  through  9,  in 
Table  4-5,  confirm  those  found  earlier.  Across  all  specifications,  the  probability  that  a 
child  passed  the  math  section  on  the  SAT-9  increased  following  PRWORA  in  a  range  of 
4.1  to  1 1%.  Signs  on  BLACK,  ELIGIBLE  and  GRADE  are  significant  and  consistent 
with  the  earlier  results.  As  before,  it  seems  that  the  student  and  grade  combination  of 
fixed  effects  are  doing  more  to  explain  the  variation  in  math  scores.  As  expected, 
specifications  6  and  9  imply  that  outcomes  of  children  still  classified  after  the  policy  were 
not  significantly  affected.  Table  4-6  gives  the  results  for  the  specifications  that  predict 
the  probability  that  a  child  passes  the  reading  and  the  SAT-9.  Probability  of  passing  the 
reading  section  increased  by  6.1  to  14%,  while  the  probability  of  passing  the  SAT-9  rose 
5.4  to  13.1% 


5  Where  SAT9  =  Reading  +  Math 
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Next,  an  alternative  reduced  form  model  is  developed  that  controls  for  the  parental 
inputs  in  another  way.  As  previously  discussed,  controlling  for  parental  inputs  can  be 
difficult,  and  the  past  literature  is  inconclusive  on  which  elements  are  most  important. 
While  specific  parental  data  were  not  available,  data  that  indirectly  give  an  indication  of 
parental  involvement  in  their  child's  education  level  were.  Census  data  provide  an 
alternative  resource  to  control  for  average  parental  inputs.  While  this  information  is 
readily  available  at  the  district  level,  it  is  of  no  use.  Less  aggregated  data  are  needed  for 
this  analysis.  Luckily,  the  1990  census  data  for  census  tracts  are  available.  Census  tract 
boundaries  were  drawn  onto  maps  of  the  two  districts,  and  302  elementary  schools  were 
plotted  onto  those  maps.  Most  tracts  contained  two  or  more  schools,  and  the  total 
number  of  tracts  across  both  districts  was  153.  Data  were  collected  for  each  tract  that 
contained  a  school.  Table  4-7  gives  the  summary  statistics  for  five  variables  that  link 
parental  inputs  to  student  achievement.  Inputs  at  the  parent  level  should  be  linked  to 
student  performance  by  either  quality  or  quantity.  As  the  quantity  of  time  that  parents 
spend  with  their  children  increases,  this  should  have  a  positive  affect  on  performance. 
Likewise,  as  the  quality  of  those  parent-  child  interactions  rises,  the  child's  achievement 
should  rise. 

Across  both  districts  the  average  number  of  persons  per  family  is  3.28.  Number  of 
persons  per  family  is  used  as  a  proxy  for  the  quantity  of  time  spent  with  children.  As  the 
number  of  persons  in  each  family  increases,  less  time  can  be  devoted  to  the  each  member 
of  the  family  by  the  parents.  One  example  of  this  in  the  literature  is  seen  in  a  study  by 
Hanushek  (1992).  He  uses  1971  to  1975  data  from  the  Gary  Income  Maintenance 
Experiment  to  estimate  the  relationship  between  family  size  and  scores  on  the  Iowa 
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Reading  Comprehension  and  Vocabulary  tests.  Over  all  specification  he  finds  a  negative 
elasticity,  in  the  range  of -0.28  to  -0.30,  between  number  of  children  and  achievement.  It 
should  also  be  true  in  this  study  that  as  the  number  of  persons  per  family  rises,  student 
performance  on  the  SAT-9  should  fall. 

Average  female  labor  force  participation  is  another  measure  of  the  quantity  of  time 
spent  with  children,  and  the  mean  rate  in  this  data  is  57.78%.  Even  though  not  all 
females  in  the  labor  force  are  mothers,  this  measure  should  serve  as  an  adequate  proxy 
for  maternal  time  investment.  As  maternal  labor  force  hours  increase,  children's 
achievement  should  suffer.  Using  a  sub-sample  from  the  1960  Project  TALENT,  Kenny 
(1980)  shows  an  inverse  relationship  between  mother's  market  time  and  cognitive  skills. 

The  quality  aspect  of  parental  inputs  is  captured  by  the  percent  of  the  population 
who  are  foreign  born,  which  is  29.46%  on  average  in  this  sample.  While  the  ability  of 
these  families  to  assimilate  into  society  depends  on  how  long  they  have  lived  in  the  area, 
difficulties  in  communication,  resource  availability,  and  social  interaction  are  all  likely. 
Children  from  immigrant  families  are  more  likely  to  have  language  barriers,  and 
immigrant  families  overall  have  less  human  capital.  In  their  study,  Portes  and  MacLeod 
(1996)  examine  the  effect  of  recent  immigrant  waves  in  California  and  Florida  by  Cuban, 
Vietnamese,  Haitian,  and  Mexican  immigrants.  Over  5,000  eighth  and  ninth  grade  school 
children  in  Miami  and  San  Diego  were  surveyed.  Survey  data  were  merged  to 
educational  statistics  to  predict  scores  on  the  Stanford  Achievement  Test.  Results  show 
that  in  both  Florida  and  California,  second-generation  immigrants  scored  lower  on  both 
reading  and  math  sections  of  the  test  than  their  native  counterparts.  Mexican  students 
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had  the  lowest  scores.  I  test  the  hypothesis  that  as  the  percent  of  foreign-born  families 
increase,  test  scores  should  fall. 

Numerous  studies  have  found  that  higher  levels  of  parental  educational  attainment 
lead  to  greater  student  performance.  More  educated  parents  are  better  equipped  at 
helping  their  child  with  homework,  locating  and  utilizing  educational  resources,  and 
stimulating  their  child's  interest  in  school.  The  measure  of  educational  attainment  in  this 
study  is  the  percent  with  at  least  a  bachelor  degree.  Holding  constant  the  time  parents 
spend  with  their  child,  if  the  quality  of  their  instruction  and  guidance  is  increased  due  to 
higher  educational  attainment,  the  result  should  be  an  increase  in  a  child's  test 
performance. 

Lastly,  the  percentage  of  the  tract  that  is  black  is  used  as  a  measure  of  quality  of  a 
parent's  inputs.  On  average,  black  parents  tend  to  have  attended  lower  quality  schools 
than  their  white  counterparts.  When  black  parents  have  received  reduced  quality 
education,  those  parents  lose  the  ability  to  pass  on  their  knowledge  to  their  child  as 
efficiently.  Therefore,  as  the  percent  of  the  black  population  rises,  test  scores  should  fall. 

Results  from  the  reduced  form  models  that  included  these  census  variables  are 
reported  in  Table  4-8  for  the  level  math  score  and  Table  4-9  for  the  probability  of  passing 
the  math  section  of  the  test.  Table  4-8  gives  the  results  for  the  specifications  with  grade 
and  student  fixed  effects.  Specifications  1  and  2  show  that  the  policy  increased  math 
scores  by  3.51  to  3.57  points.  Likewise,  specifications  4  and  5  showed  an  increase  of 
2.52  to  2.82  points.  In  all  six  specifications,  the  derivative  with  respect  to  income 
eligibility  implies  that  poor  children  have  lower  test  scores. 
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Other  than  the  individual  indicators,  the  census  variables  yield  interesting  results. 
In  five  of  the  six  specifications  that  predict  math  scores,  the  PERSONS  PER  FAMILY 
variable  has  the  incorrect  and  insignificant  sign.  This  may  be  due  to  collinearity  with 
another  variable  that  also  captures  quantity  of  time.  Across  all  specifications,  when 
significant,  the  variables  PERCENT  BLACK,  PERCENT  FOREIGN  BORN,  PERCENT 
BACHELORS  and  PERCENT  FEMALES  IN  LABOR  FORCE  have  the  correct  sign. 
When  incorporating  student  fixed  effects,  the  PERCENT  BACHELORS  and  PERCENT 
FEMALES  IN  LABOR  FORCE  become  insignificant,  which  may  be  due  to  collinearity 
with  the  student  fixed  effects.  Table  4-9  only  gives  the  policy  effects  from  the  same 
specifications  for  reading  and  SAT-9  scores.  Again,  all  the  results  corroborate  the 
evidence  that  PRWORA  led  to  welfare  gains  by  increasing  reading  scores  from  2.52  to 
6.91  points  and  SAT-9  scores  from  2.52  to  6.94  points. 

As  before,  the  dependant  variable  is  changed  to  a  dummy  variable  indicating 
whether  a  student  passes  the  math  section  on  the  SAT-9.  Table  4-10  gives  the  full  results 
for  the  probability  of  passing  the  math  section,  while  Table  4-1 1  reports  the  abbreviated 
results  for  the  policy  effect  on  passing  the  reading  and  SAT-9.  Table  4-10  shows  that  in 
all  but  specification  3,  the  policy  led  to  an  increase  in  the  probability  of  passing  the  math 
section  by  6.7  to  10.4%.  Again,  the  PERCENT  BLACK,  PERCENT  FOREIGN  BORN, 
PERCENT  BACHELORS  and  PERCENT  FEMALES  IN  LABOR  FORCE  variables  are 
consistent  with  the  hypothesis  when  significant.  Interestingly,  PERSONS  PER  FAMILY 
still  has  the  incorrect  sign,  but  is  not  significant  in  2  of  the  6  regressions. 
4.4.2  Probit  Model 

Since  the  dependent  variable  passed  math  takes  on  a  binary  form,  the  robustness  of 
the  results  should  be  checked  for  functional  form.  The  reduced  form  equation  is  again 
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estimated,  but  in  a  probit  model.  Being  unable  to  incorporate  student  or  school  fixed 
effects  in  such  a  model,  the  census  variables  are  used  as  a  way  to  control  for  parental  or 
school  inputs.  Table  4-12  presents  the  results  after  replacing  the  coefficients  with  the 
estimated  marginal  effects,  to  ease  interpretation.  For  the  entire  population  and  the  not 
classified  group,  the  probability  that  a  child  will  pass  the  math  section  of  the  SAT-9 
increases  by  2.9  to  3.1%  following  PRWORA.  Focusing  on  the  signs  of  the  census 
variables,  again  the  only  variable  that  seems  inconsistent  with  its  expected  effect  is 
PERSONS  PER  FAMILY.  In  specifications  that  yield  significant  results,  GRADE, 
ELIGIBLE,  PERCENT  BLACK,  PERCENT  FOREIGN  BORN,  PERCENT 
BACHELORS,  and  PERCENT  FEMALES  IN  LABOR  FORCE  all  show  the  expected 
signs.  Table  4-13  gives  the  estimated  policy  effect  on  the  probability  that  a  child  passed 
the  reading  and  SAT-9.  Again,  the  results  indicate  that  for  the  overall  population  and 
those  not  classified,  PRWORA  led  to  welfare  gains. 

4.4.3  Comparison  Group  Estimations 

Evidence  from  the  previous  models  seems  to  indicate  that  welfare  gains  from 
PRWORA  were  realized  for  the  overall  population  and  for  students  who  were  not 
classified  as  having  a  disability  after  the  policy.  However,  this  conclusion  may  be  flawed 
in  that  it  does  not  account  for  the  differential  policy  effects  on  different  groups  of 
students  that  were  not  classified  after  PRWORA.  More  precisely,  the  effects  across  all 
groups  must  be  disentangled  so  that  the  effect  on  the  group  of  students  that  were 
classified  prior  to  PRWORA  and  then  no  longer  classified  following  PRWORA  must  be 
isolated  from  the  effects  of  those  students  who  were  never  classified.  This  is  essential  to 
the  argument  that  children  were  being  inappropriately  matched  to  their  educational 
setting  and  thus  PRWORA  caused  welfare  gains  by  correcting  this  phenomenon.  In  order 
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to  compare  these  differential  effects  of  PRWORA,  students  were  separated  out  into  four 
groups.  Students  who  were  not  classified  prior  to  and  following  PRWORA  were  given 
an  indicator  of  OUT-OUT.  Students  who  were  classified  as  disabled  in  both  time  periods 
were  designated  as  IN-IN  students.  Students  who  transitioned  into  special  education  after 
PRWORA  were  indicated  as  OUT-IN,  and  students  who  were  initially  classified  and 
subsequently  removed  following  PRWORA  were  designated  as  IN-OUT.  Using  OUT- 
OUT  as  the  residual  group,  the  estimated  effects  are  determined  using  the  following 
equation. 

(4)      MATHjt  =  d  +  60UT-INit  +  fjIN-INit  +  SIN-OUT;,  +  KELIGIBLEit 
lit  +  6it  +  ©it  +  Hk 

where  i  indicates  individual,  t  indicates  year  and  i,  6,  and  6  represent  parent,  school  and 
student  fixed  effects  parameters. 

Next,  the  time  trends  in  math  scores  for  the  IN-OUT  population  must  be 
considered.  It  is  imperative  that  scores  from  when  these  children  were  classified  are 
separated  from  when  they  were  no  longer  classified.  By  comparing  these  relative 
changes  the  welfare  effects  on  this  group  can  be  correctly  contributed  to  the  policy.  To 
control  for  these  trends,  IN-OUT  becomes  two  different  dummy  variables:  IN-OUTearly 
and  IN-OUTlate.  The  variable  IN-OUTearly  is  an  indicator  for  children  who  were 
classified  in  the  early  years,  or  the  years  before  PRWORA.  Likewise,  IN-OUTlate 
indicates  a  child  who  was  no  longer  classified  in  the  years  following  PRWORA.  This 
separation  must  be  performed  in  order  to  isolate  the  effects  before  and  after  the  policy.  If 
it  is  hypothesized  that  PRWORA  brought  positive  welfare  effects  to  these  children,  then 
the  difference  in  coefficients  on  IN-OUTlate  and  IN-OUTearly  should  be  positive. 
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Alternatively,  if  the  policy  caused  welfare  losses  for  these  children,  then  IN-OUTearly 

will  be  greater  than  IN-OUTlate.  The  equation  then  becomes 

(5)      MATHit  =  6  +  80UT-OUTit  +  rjlN-INi,  +  \>IN-OUTearlyit  +  rlN- 
OUTlateit  +  5'BLACKit  +  KELIGIBLEit  +  iit  +  6it  +  rait  +  uit 

where  i  indicates  individual,  t  indicates  year  and  i,  6  and  <b  represent  parent,  school  and 

student  fixed  effects  parameters. 

Finally,  income  eligibility  must  be  controlled  for.  Since  the  policy  had  a  different 

effect  on  children  who  were  income  eligible  than  those  who  were  not,  this  eligibility  must 

be  controlled  for.  To  do  so,  the  model  is  estimated  across  the  entire  population  while 

incorporating  the  income  eligibility  dummy  variable  and  the  sample  is  divided  by 

eligibility  status.  Student,  parent  and  school  inputs  are  again  captured  by  the  use  of  fixed 

effects  and  census  data.  Table  4-14  presents  the  results  of  the  estimation  of  equation  5. 

Specifications  1,  2  and  3  only  include  grade  fixed  effects,  while  specifications  4,  5  and  6 

control  for  both  grade  and  school  fixed  effects.  Specification  1  shows  that  children  who 

were  income  eligible  and  black  scored  lower  than  the  control  group  by  24.76  and  18.26 

points  respectively.  Children  who  were  not  classified  prior  to  the  policy  and  classified 

after  the  policy,  OUT-IN,  scored  29.43  points  less  than  the  control  group  of  students  who 

were  never  classified.  Likewise,  students  who  were  always  classified  scored  15.64  points 

less  than  the  control  group.  Finally,  the  group  of  most  interest,  IN-OUT,  is  evaluated. 

Specification  1  reports  that  prior  to  PRWORA  children  in  this  group  did  not  score 

significantly  different  than  the  control  group.  However,  following  the  policy,  these 

children,  being  no  longer  classified,  scored  7.73  points  higher  than  the  control  group. 

Taking  the  difference  in  coefficients  from  IN-OUTlate  and  IN-OUTearly,  the  results 

indicate  that  after  the  policy  students  in  this  group  gained  over  7  points  on  the  math 
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section  of  the  SAT-9.  The  results  suggest  that  while  children  in  this  group  were  not 
necessarily  being  adversely  affected  prior  to  the  policy  they  defiantly  were  better  off  after 
being  no  longer  classified  as  disabled. 

Specifications  2  and  3  divide  the  sample  into  eligible  and  not  eligible  children.  In 
specification  2,  for  ineligible  children,  the  results  yield  the  same  overall  pattern.  It 
should  be  expected  that  the  score  gain  for  these  children  be  a  smaller  magnitude,  as  they 
were  not  directly  affected  by  the  policy,  and  it  is  at  6.95  points.  Again,  as  compared  to 
the  control  group,  children  in  the  IN-OUT  category  performed  better  on  the  math  section 
of  the  SAT-9  after  being  declassified.  Next,  specification  3  isolates  the  income  eligible 
children.  This  is  important  since  these  children  would  have  been  directly  affected  by  the 
policy.  The  results  show  that  as  compared  to  the  control  group,  OUT-IN  and  IN-IN 
students  scored  28.83  and  14.50  points  lower,  as  did  black  students  at  16.42  points  less. 
The  IN-OUT  group  showed  no  significant  scoring  difference  from  the  control  group  prior 
to  PRWORA,  but  scored  8.37  points  higher  following  the  policy.  It  should  be  expected 
that  the  magnitude  for  IN-OUTlate  is  higher  than  it  is  in  the  other  two  specifications. 
This  expectation  is  based  on  the  theory  that  the  policy  affected  income  eligible  children 
more  than  not  eligible  children.  Thus,  the  coefficient  estimate  for  the  eligible  group 
should  be  higher,  and  it  is. 

Adding  school  fixed  effects  are  important  to  this  model  since  the  only  controls  are 
group,  income  eligibility  and  race.  By  incorporating  the  school  fixed  effects,  the  average 
school  levels  of  student  ability,  parental  time  investment  and  school  inputs  can  be 
controlled  for.  Specifications  4,  5  and  6  denote  the  different  samples  used.  Overall,  the 
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specifications  yield  similar  patterns  of  signs  and  magnitudes.  All  results  are  significant, 
and  including  the  school  fixed  effects  adds  to  the  explanatory  power  of  the  model. 

Table  4-15  shows  the  results  when  reading  scores  were  used  as  the  dependant 
variable,  while  Table  4-16  uses  SAT-9  as  the  dependant  variable.  Focusing  only  on 
specifications  3  and  6,  since  these  isolate  the  eligible  children  who  would  have  been  most 
affected  by  the  policy,  the  IN-OUTlate  variable  indicates  that  students  scored  7.96  and 
7.88  points  higher  on  the  reading  section  and  16.33  and  16.45  points  higher  on  both 
sections.  Across  all  specifications  IN-OUTearly  reports  that  students  in  this  group  did 
not  score  significantly  different  than  those  in  the  control  group. 

Given  that  the  results  are  different  for  eligible  and  not  eligible  students,  it  would  be 
beneficial  to  use  a  difference  in  difference  approach  here  to  create  a  lower  bound  on 
eligible  children  who  are  in  the  INOUT  group.  Also,  this  creates  a  natural  control  and 
treatment  group  that  would  have  been  subject  to  any  other  educational  or  legislative 
changes  that  occurred.  To  do  so  the  eligible  variable  is  interacted  with  the  INOUT 
variable  and  the  differential  effect  on  the  eligible  students  is  found.  Controlling  for  grade 
fixed  effects,  students  who  were  income  eligible  increased  their  standardized  math  scores 
by  1 .98  points  with  a  standard  error  of  0. 196.  Likewise,  reading  scores  rose  by  1 .69 
points  with  a  0.17  standard  error  and  SAT-9  scores  increased  2.91  points  with  a  standard 
error  of  0.34. 

Before  moving  on  to  another  specification  it  is  important  to  interpret  the  results  in 
context  to  historical  trends.  On  average,  students  gain  2.4  points  on  the  SAT-9  per  month 
of  classroom  instruction.  In  comparison,  the  eligible  students  in  this  sample  gained  2.91 


These  results  are  not  reported  in  a  table,  but  are  available  from  the  author. 
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points  after  PRWORA.  Thus,  students  gained  slightly  more  than  one  month's  instruction 
time  after  the  policy.  In  terms  of  days,  students  increased  their  classroom  instruction  by 
36.4  days  due  to  PRWORA. 

Finally,  the  census  data  are  used  to  control  for  parental  inputs.  Table  4-17  reports 
the  results  for  math  scores  over  all  groups  and  includes  the  census  variables  while  Table 
4-18  and  4-19  reports  the  results  for  reading  and  SAT-9.  Three  specifications  are 
presented  and  all  control  for  grade.  Specifications  1,  2  and  3  show  that  the  significance, 
signs  and  magnitudes  are  similar  to  those  found  previously.  Beyond  the  estimations  on 
the  comparison  groups,  the  coefficient  signs  on  the  census  variables  can  be  examined.  In 
all  three  specifications  the  sign  on  BLACK  is  negative  and  significant.  Percent  with  a 
bachelors  degree  gives  the  expected  positive  sign  and  is  significant  in  all  three 
specifications.  The  remaining  three  variables  give  mixed  results.  The  variable 
PERSONS  PER  FAMILY  does  not  report  the  expected  sign  in  specifications  1  and  2,  and 
is  insignificant  in  specification  3.  The  variable  describing  percent  of  females  in  the  labor 
force  only  shows  the  expected  sign  in  the  specification  that  includes  not  eligible  students. 
Also,  percent  of  foreign  born  provides  the  expected  sign  in  two  of  the  three 
specifications.  One  reason  for  these  mixed  results  could  be  a  collinearity  problem. 

Overall,  the  conclusions  concerning  the  welfare  effects  are  the  same.  The  eligible 
IN-OUT  students  scored  higher  than  the  control  group  after  they  had  been  removed  from 
special  education.  This  suggests  that  those  students  may  have  been  inappropriately 
classified  and  that  resources  were  not  being  used  in  the  most  efficient  manner. 


4.5  Conclusion 

The  question  asked  in  this  chapter  was,  "Did PRWORA  help  or  hurt  disabled 
children?  "  Overwhelming  evidence  in  this  research  has  suggested  that  PRWORA  helped 
children  who  had  been  classified  as  disabled. 

Using  two  separate  approaches,  I  found  evidence  that  at  least  some 
misclassification  was  happening  prior  to  the  policy  change.  In  the  first  approach,  or  the 
reduced  form  model,  I  used  a  variety  of  parent,  student  and  school  controls  to  show  that 
students  in  the  overall  population  and  those  not  classified  benefited  from  welfare  gains  by 
increasing  their  math,  reading  and  overall  SAT-9  scores.  Math  scores  increased  between 
2.23  and  2.85  points,  while  reading  scores  increased  between  2.77  and  5.92  points.  These 
results  suggest  that  PRWORA  led  to  welfare  gains  across  the  entire  population  and  for 
the  not  classified  students. 

A  second  approach,  with  a  tighter  specification,  took  advantage  of  the  actual 
classification  data  to  estimate  the  effect  of  PRWORA  more  precisely.  By  isolating  the 
group  of  students  who  were  removed  from  special  education  following  the  policy,  I  can 
directly  measure  their  changes  in  test  score  following  the  policy.  This  approach  is  more 
precise,  as  it  separates  the  effects  of  the  IN-OUT  group  from  the  group  of  children  who 
were  never  classified.  By  separating  out  the  before  and  after  effects  on  the  IN-OUT 
group,  and  further  isolating  the  income  eligible  group,  the  implications  of  being  better 
matched  to  educational  setting  due  to  PRWORA  can  be  estimated.  For  this  group  of 
students,  the  results  suggest  that  on  average,  the  policy  has  led  to  significant  welfare 
gains  by  means  of  higher  test  scores  in  the  range  of  8.37  to  8.97  for  math  scores,  7.88  to 
8.62  for  reading  scores  and  16.33  to  17.59  points  for  the  SAT-9.  Using  a  difference  in 
difference  approach,  to  control  for  extemporaneous  legislative  or  educational  changes 
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that  may  have  been  occurring  at  the  same  time  as  PRWORA,  the  results  show  that  SAT-9 
scores  increased  by  2.91  points  differentially  for  the  eligible  students  in  the  INOUT 
group.  Translating  this  into  classroom  time  indicates  that  eligible  students  gained  over  36 
days  of  classroom  instruction  following  PRWORA. 

Unfortunately,  a  few  tough  issues  must  be  addressed  in  order  to  determine  the 
value  of  the  results.  First,  one  can  never  prove  with  certainty  that  parental  coaching 
existed.  Even  if  parents  were  available  for  individual  interviewing,  the  results  may  still 
be  unreliable.  Therefore,  the  results  from  this  research  cannot  lead  to  any  definite 
conclusions.  At  most,  these  results  can  only  suggest  that  the  policy  helped  to  fix  a 
financial  incentive  that  may  have  been  perverse.  This  is  not  to  suggest  that  this  research 
has  no  value,  other  studies  have  tried  to  prove  that  coaching  existed.  However,  it  is  to 
say  that  by  using  reliable  data  and  careful  econometric  techniques,  evidence  can  be  found 
that  implies  that  misclassification  did  exist  prior  to  PRWORA.  Second,  the  results  may 
have  been  tainted  by  impending  education  legislature  changes.  Specifically,  in  1999 
Florida  began  to  implement  the  Sunshine  State  Standards.  These  standards  were  the  start 
of  an  accountability  program  designed  to  use  funding  as  a  leverage  to  increase  school 
quality.  And  while  the  data  used  in  this  study  clearly  were  collected  before 
accountability  became  an  issue,  there  is  the  chance  that  schools  and  teachers  were  aware 
that  accountability  was  coming  and  began  to  prepare  for  it.  For  example,  it  may  have 
been  that  case  that  historically  low -performing  schools  may  have  begun  to  intensify  their 
standardized  test  preparation.  Could  this  have  affected  SAT-9  scores,  even  though  SAT- 
9  was  not  the  standardized  test  used  once  accountability  started?  Maybe.  In  the  very 
least,  it  must  be  introduced  as  a  possibility  that  changes  other  than  PRWORA  caused 


SAT-9  scores  to  increase.  Regardless,  this  study  has  conclusively  shown  that  scores 
increased  after  the  policy  change.  Furthermore,  income  eligible  children  differentially 
increased  their  scores  more  than  their  not  eligible  counterparts,  which  is  not  consistent 
with  the  accountability  explanation.  Again,  these  results  suggest  that  after  the  policy  a 
more  efficient  use  of  resources  was  realized. 

In  September  2002,  the  re-authorization  of  PRWORA  began.  Congress  has  been 
called  upon  to  reinstate,  alter  and  introduce  new  changes  into  the  original  legislation.  It 
is  essential  that  government  and  the  academic  community  continue  to  provide  a  system  of 
checks  and  balances  of  this  legislation.  No  one  agency  has  all  the  answers,  but 
evaluating  these  changes  will  give  the  government  and  its  citizens  an  idea  of  their  value. 
The  Personal  Responsibility  and  Work  Opportunity  Reconciliation  Act  is  unique  in  this 
system  because  there  are  many  opportunities  for  quality  academic  research  to  be 
performed.  Hopefully,  this  dissertation  can  be  extended  in  the  future  as  the  evaluation  of 
PRWORA  becomes  increasingly  more  important  for  low-income  families  in  America. 
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Table  4-1.  Summary  Statistics 


v  anaDic 

T\Apan  in  ftill 

1Y1LCU1  ill  LUU 

Standard  Mean  in  disability  sub- 

Standard 

c  amole 

deviation 

ELIGIBLE 

60.39% 

62.35% 

CLASSIFIED 

8.20% 

100% 

MATH 

592.45 

64.84 

565.71 

50.96 

READING 

586.26 

55.37 

563.54 

43.17 

SAT-9 

1178.71 

113.62 

1129.26 

120.35 

PASS  READING 

48.15% 

21.84% 

PASS  MATH 

45.50% 

23.32% 

PASS  SAT-9 

46.59% 

21.57% 
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Table  4-2.  Disability  by  category 


Category  Percent  of  disabled  students 

who  took  the  test 


JiOUcaDic  mentally  riaiiuiLappcu 

93 

TVainaKIp  mp-nfrallv  ViandirarjOPn 
J.  I  euIlalJlC  lllcllLcUiy  iicmuiLa^|^i*\i 

92 

Orthopedic  ally  handicapped 

97 

98 

Language  uno  aired 

98 

Hearing  impaired 

99 

Visually  impaired 

100 

Emotionally  handicapped 

94 

Specific  learning  disabled 

97 

Homebound 

76 

Profoundly  mentally  handicapped 

94 

Autistic 

92 

Severely  emotionally  disturbed 

100 

Traumatic  brain  injury 

89 

Developmental^  delayed 

100 

Other  health  impaired 

96 

1995      1996      1997  1998 


Figure  4-2.  Average  math  scores  over  time 
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1995      1996      1997      1998  1999 


Figure  4-3.  Average  math  scores  over  time  for  disabled  students 
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Table  4-3.  Reduced  form  regressions  for  math 


Dependant  variable 

MATTT 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

Specification 

1 
1 

c 

•3 
3 

4 

5 

$ 

7 

8 

9 

Group 

All 

Not 

Classified 

ah 
Ail 

INOt 

^lassmeu 

All 
/\ll 

Not 

classified 

classinea 

classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Student 

Student 

Student 

— z~r — j — 

School 

School 

— c~u — i  

Grade 

uraae 

uraae 

Grade 

kjraoe 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coemcient 

Coefficient 

Coefficient 

^  OCLULiClll 

t'l'iPTTlrM^flt 
v.-  U  ClliL-lCllL 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

EUGIBLE^PRWORA* 

2  85 

278 

1.16 

223 

24 

-2  37 

265 

271 

0  93 

GRADE 

(0.720) 

(0.750) 

(2780) 

(0  720) 

(0.760) 

(2  920) 

(0705) 

(0720) 

(2  540) 

ELIGIBLE*PRWORA 

1.39 

1.42 

3.22 

0.36 

0  58 

2.23 

1.49 

1.52 

3  56 

(0.610) 

(0.620) 

(2.510) 

(0.504) 

(0.520) 

(2.320) 

(0.590) 

(0.590) 

(2.270) 

ELIGIBLE'GRADE 

-1032 

-1005 

-9.35 

-11.39 

-11.46 

-6.59 

-11.27 

-11.16 

-5.99 

(0.620) 

(0  640) 

(2  350) 

(0.670) 

(0710) 

(2  670) 

(0  620) 

(0  630) 

(2  190) 

PRWORA*GRADE 

-982 

-9.73 

-9.5 

6.52 

633 

9.15 

-94 

-935 

-9.1 

(0.590) 

(0  610) 

(2  370) 

(0.560) 

(0.590) 

(2.370) 

(0  560) 

(0  570) 

(2  080) 

ELIGIBLE 

-1991 

-198 

-20  29 

5.73 

5  39 

4.3 

-12  61 

-11.31 

-15.51 

(0. 520) 

(0.530) 

(2  120) 

(0.503) 

(0.520) 

(2  270) 

(0  510) 

(0.490) 

(1.960) 

PRWORA 

11.67 

11.77 

7.7 

24  33 

24.67 

20  33 

11.16 

11.31 

7.28 

(0.510) 

(0  520) 

(2  160) 

(0410) 

(0430) 

(1  940) 

(0470) 

(0490) 

(1  880) 

GRADE 

77.11 

79  19 

64.5 

54  56 

55  07 

38  39 

76.7 

7879 

57.78 

(0.510) 

(0.520) 

(2.000) 

(0.520) 

(0B40) 

(2  190) 

(0490) 

(0  503) 

(1  790) 

BLACK 

-18.46 

-18.81 

-14.4 

-15.99 

-16.08 

-1438 

(0  22) 

(0.150) 

(0430) 

(0  19) 

(0  20) 

(0  58) 

Adjusted  R3 

0  35 

0  37 

0.28 

Within  R2 

0  5 

0.5 

0  37 

034 

037 

0  27 

Standard  errors  are  in  parenthesis 
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Table  4-4.  Reduced  form  regressions  for  reading  and  SAT-9 


Dependant  variable 

READING 

READING 

READING 

READING 

READING 

READING 

READING 

READING 

READING 

Specification 

1 

2 

3 

4 

j 

c 
O 

7 

g 

9 

Al 

Not  classified 

Classified 

All 

Not  classified 

Classified 

Al 

Not 
classified 

Classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Student 
Grade 

Student 
Grade 

Student 
Grade 

School 
Grade 

School 
Grade 

School 
Grade 

Variable 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

ELIGIBLE*PRWORA 
•GRADE 

3  22 
(0  740) 

281 
(0760) 

7  18 
(2  750) 

5  92 
(1  670) 

512 
(1740) 

14  8 

(6.700) 

3  09 
(0  610) 

277 
(0  620) 

729 
(2  090) 

Adjusted  R2 

037 

038 

0  31 

WithmR2 

0.52 

052 

056 

0.31 

04 

032 

Dependant  variable 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

Specification 

1 
I 

0 
c 

3 

4 

5 

6 

7 

8 

9 

Group 

All 

Not  classified 

Classified 

All 

Not  classified 

Classified 

All 

Not 
classified 

Classified 

Fixed  Effect* 

Grade 

Grade 

Grade 

Student 
Grade 

Student 
'Grade 

Student 
Grade 

School 
Grade 

School 
Grade 

School 
Grade 

Variable 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

ELK3BLE*PRWORA 
•GRADE 

608 

(1  360) 

561 
(1  390) 

8  35 
(5  060) 

14.1 
(3.320) 

13  17 

(3  500) 

17  01 
(13050) 

5.74 
(1  220) 

5  47 

(1.240) 

8.03 
(4  260) 

Adjusted  R3 

0.39 

041 

0  32 

WithmR2 

0.73 

0.73 

069 

0.41 

043 

0.33 

Standard  errors  are  m  parenthesis 
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Table  4-5.  Reduced  form  regressions  for  passing  math 


Dependant  variable 

PASS 

PASS 

PASS 

PASS 

PASS 

PASS 

PASS 

PASS 

PASS 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

OpC  LLL1L  dUUIi 

1 

2 

3 

4 

5 

6 

7 

8 

9 

Group 

All 

Not 

Classified 

All 

Not 

Classified 

AD 

Not 

Classified 

classified 

classified 

classified 

 Grade  

Grade 

Grade 

Student 

Student 

Student 

School 

School 

School 

Grade 

Grade 

Grade 

Grade 

Grade 

Grade 

v  ailaOlC 

C  o  efficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

CSUXIlalC 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

FT  TfVTRT  F*PRWORA 

0  066 

0  067 

0.041 

0  103 

0.11 

0.011 

0063 

0.065 

004 

ATTF 

(0  0059) 

(0  0061) 

(0.0180) 

(0  0190) 

(0.0201) 

(0.0790) 

(0.0065) 

(0.0066) 

(0  0230) 

FT  TnTRT  F^PRWOT?  A 

-0  022 

-0  022 

-0  00504 

-0  048 

-0.052 

-00066 

-0  021 

-0.021 

-00052 

(0  0045) 

(0  0045) 

(0  0400) 

(0  0150) 

(0.0150) 

(0.0650) 

(0.0054) 

(0  0055) 

(0  0210) 

FT  TOTRT  F*GRADE 

-0.2 

-0.19 

-0  23 

-0.19 

-0  202 

-0.14 

-0.19 

-0.19 

-0.19 

CO  0050") 

(0.0052) 

(0.0150) 

(0  0160) 

(0.0170) 

(0.0730) 

(0.0056) 

(0.0058) 

(0.0250) 

PRWORA*GRADE 

-0049 

-0.049 

-0  042 

-0017 

-0.012 

-0.042 

-0  044 

-0.044 

-0039 

(0.0049) 

(0  0051) 

(0  0160) 

(0.0160) 

(0  0160) 

(0.0660) 

(0  0052) 

(0.0053) 

(0  0190) 

ELIGIBLE 

-0  068 

-0  071 

-0  024 

-0.0013 

-0.0018 

-0  084 

-0  021 

-0.019 

U.UUUoo 

(0  0036) 

(0  0038) 

(0  0110) 

(0  0130) 

(0.0130) 

(0.0620) 

(0.0047) 

(0.0047) 

(0  0180) 

PRWORA 

0.058 

0.059 

0  026 

0  107 

0.11 

0041 

0  054 

0  056 

0024 

(0.0040) 

(0.0041) 

(0.0130) 

(0.0120) 

(0.0130) 

(0  0540) 

(0  0044) 

(0.0045) 

(00170) 

GRADE 

0.53 

0.55 

0.37 

0.44 

0.45 

0  22 

0.51 

0.53 

031 

(0.0041) 

(0  0042) 

(0  0140) 

(00140) 

(0  0015) 

(0  0620) 

(0.0045) 

(0.0047) 

(0  0160) 

BLACK 

-0.12 

-0.13 

-0  099 

-0.12 

-0.13 

-0  15 

-0.16 

-0  11 

-0.11 

(0  0013) 

(0  0014) 

(0  0039) 

(0.0053) 

(0  0056) 

(0  0029) 

(00017) 

(0  0018) 

(0  0050) 

Adjusted  R2 

0  22 

0.24 

0  12 

Within  R2 

0  26 

0.27 

0.1 

0.15 

0  17 

006 

Standard  errors  are  in  parenthesis 
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Table  4-6.  Reduced  form  regressions  for  passing  reading  and  SAT-9 


Dependant  variable 

PASS 
READING 

PASS 
READING 

PASS 
READING 

PASS 
READING 

PASS 
READING 

PASS 
READING 

PASS 
READING 

PASS 
READING 

PASS 
READING 

Specification 

1 

2 

3 

4 

5 

6 

7 

8 

9 

Group 

All 

Not  classified 

Classified 

All 

Not 
classified 

Classified 

All 

Not  classified 

Classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Student 
Grade 

Student 
Grade 

Student 
Grade 

School 
Grade 

School 
Grade 

School 
Grade 

Variable 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 

C  j  UillaLC 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

ELIGIBLE*PRWORA* 
GRADE 

0.066 

0.065 
\y.WOO) 

0  06 

CO  0190^ 

V.  1M 

(0  0190) 

-0  013 
(0  0760) 

0  064 
(0.0066) 

0.064 
(0.0067) 

0  061 

(0.0230) 

Adjusted  R2 

0  21 

023 

0  12 

Within  R2 

0  58 

053 

0  54 

0  19 

0  21 

0  15 

Dependant  variable 

PASS 

CAT  Q 

PASS 

jAI-7 

PASS 
SAT-9 

PASS 
SAT-9 

PASS 
SAT-9 

PASS 
SAT-9 

PASS 
SAT-9 

PASS 
SAT-9 

PASS 
SAT-9 

Specification 

l 

2 

3 

4 

5 

6 

7 

8 

9 

Group 

All 

Not  classified 

Classified 

AH 

Not 

L. 1  azi  ailiC  LA 

Classified 

All 

Not  classified 

Classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Student 
Grade 

Student 
Grade 

Student 
Grade 

School 
Grade 

School 
Grade 

School 
Grade 

Variable 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
esnmate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

Coefficient 
estimate 

ELIGmLE*PRWORAs 
GRADE 

0  077 
(0  0060) 

0  078 

(0.0062) 

0.054 
(00190) 

0  12 
(0.0190) 

013 
(0  0190) 

0019 

(0.0750) 

0  075 
(0.0064) 

0.075 
(0  0066) 

0.054 
(0  0230) 

Adjusted  R2 

023 

026 

0  13 

Within  R2 

0.52 

0  52 

051 

0.25 

027 

021 

Standard  errors  are  in  parenthesis. 
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Table  4-7.  Summary  statistics  for  census  tracts  

Variable  Mean  Standard 

deviation 

PERSONS  PER  FAMILY  3.28  0.36 

PERCENT  BLACK  24.76% 
PERCENT  BACHELORS  18.15% 
PERCENT  FOREIGN  BORN  29.46% 
PERCENT  FEMALES  IN  57.78% 
LABOR FORCE 
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Table  4-8.  Reduced  form  regressions  using  census  data  for  math 


Dependant  variable 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

Specification 

1 

2 

3 

4 

5 

6 

Group 

All 

Not 

Classified 

All 

Not 

Classified 

Classified 

Classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Student 

Student 

Student 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

ELIGIBLE*PRWORA*GRADE 

3.51 

3.57 

1.04 

2.52 

2.83 

-2.78 

(0.810) 

(0.840) 

(3  110) 

(0.830) 

(0.870) 

(3.360) 

PT  TfTTRT  P*PT?  WOT?  A 

0.99 

1.08 

2.42 

0.33 

0.57 

1.22 

(0.680) 

(0.690) 

(2  810) 

(0  590) 

(0.590) 

(2.640) 

CL^l  win  J  c  \Ji\J\±J£i 

-13.11 

-12.88 

-10.15 

-11.47 

-11.66 

-5.78 

(0.710) 

(0  720) 

(2  640) 

(0.770) 

(0.820) 

(3.090) 

-9.26 

-9  29 

-8.31 

6.53 

6.39 

866 

(0.650) 

(0.670) 

(2  630) 

(0  630) 

(0.660) 

(2.670) 

1P,  94 

-18.56 

-20.44 

5.48 

5.06 

4.58 

(ft  SQm 

\A.  j(U) 

(ft  'SRffi 

(0.610) 

(2  630) 

PRWORA 

1  1  ^0 

1  l.JO 

1  1.00 

1  A 

">A  Of. 

94  V) 

m  um 
(V.JOU) 

(ft  Gift's 

(ft  Af,Cft 

(ft  480"! 

O  1701 

IB  41 

OU  Jo 

54.41 

38.48 

(0.560) 

(0.570) 

(2.220) 

(0  580) 

(0.620) 

(2.450) 

PFRSONS  PER  FAMILY 

1.67 

1.61 

0.38 

3.06 

2.94 

7.4 

-0.32 

-0.33 

-1.06 

-0.85 

-0.9 

-3.68 

PERCENT  BLACK 

-1.08 

-0.1 

-0.18 

-0.078 

-0.07 

-0.125 

(0.0041) 

(0.0042) 

(0.0130) 

(0.0100) 

(0.0107) 

(0.0420) 

PERCENT  FOREIGN  BORN 

0.035 

0.041 

-0.16 

-0.11 

-0.4 

-0.106 

(0.0046) 

(0.0048) 

(0.0150) 

(0.0120) 

(0.0120) 

(0.0480) 

PERCENT  BACHELORS 

0.42 

0.45 

0.107 

0.033 

0.043 

-0.05 

(0.0081) 

(0.0083) 

(0.0250) 

(0.0250) 

(0.0260) 

(0.0970) 

PERCENT  FEMALES  IN  LABOR 

-0.03 

-0.038 

0.014 

-0.091 

-0.095 

-0.047 

FORCE 

(0.0082) 

(0.0084) 

(0.0200) 

(0.0210) 

(0.0220) 

(0.0930) 

Adjusted  R 

0.36 

038 

0.28 

0.69 

0.69 

0.67 

Standard  errors  are  in  parenthesis 
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Table  4-9.  Reduced  form  regressions  using  census  data  for  reading  and  SAT-9 


Dependant  variable 

READING 

READING 

READING 

READING 

READING 

READING 

Specification 

1 

2 

3 

4 

5 

6 

NfAiin 

\_J1  uup 

All 

Not 

Classified 

All 

Not 

Classified 

classified 

classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Student 

Student 

Student 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

ELIGIBLE*PRWORA 

3.43 

3.12 

6.91 

2.52 

2  83 

-2.78 

*GRADE 

(0.820) 

(0.840) 

(1.940) 

(0.830) 

(0.870) 

(3.360) 

2 

Adjusted  R 

0.38 

0.4 

0.32 

0.69 

0.69 

0.67 

Dependant  variable 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

Specification 

1 

2 

3 

4 

5 

6 

\Jl  UUp 

All 

Not 

Classified 

All 

Not 

Classified 

clas  sified 

Fixed  Effects 

Grade 

Grade 

Grade 

Student 

Student 

Student 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

ELIGIBLE*PRWORA 

6.94 

6.71 

7.95 

252 

2.83 

-2.78 

•GRADE 

(1.510) 

(1.550) 

(5.600) 

(0.830) 

(0.870) 

(3.360) 

2 

Adjusted  R 

04 

0.43 

0.34 

0.69 

069 

0.67 

Standard  errors  are  in  parenthesis. 
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Table  4-10.  Reduced  form  regressions  using  census  data  for  passing  math 


Dependant  variable 

PASS 

PASS 

PASS 

PASS 

PASS 

PASS 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

Specification 

1 

2 

3 

4 

5 

6 

Group 

All 

Not 

Classified 

All 

Not 

Classified 

classified 

classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Student 

Student 

Student 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

ELIGBLE*PRWORA*GRADE 

0.067 

0.071 

0.033 

0.104 

0.12 

-0.088 

(0.0066) 

(0.0069) 

(0.0210) 

(0.0890) 

(0.0093) 

(0.0340) 

ELIGIBLE*PRWORA 

-0.023 

-0.023 

-0.004 

-0.049 

-0.048 

-0.034 

-0.0049 

-0.0051 

-0.0160 

-0.0061 

-0.0063 

-0.0270 

ELIGIBLE*GRADE 

-0.21 

-0.21 

-0.23 

-0.21 

-0.22 

-0.047 

(0.0056) 

(0.0059) 

(0.0170) 

(0.0082) 

(0.0087) 

(0.0320) 

PRWORA*GRADE 

-0.043 

-0.046 

-0.029 

0.083 

0.076 

0.08 

-0.0054 

-0.0056 

-0.0190 

-0.0067 

-0.0070 

-0.0270 

ELIGIBLE 

-0.064 

-0.064 

-0.026 

0.11 

0.11 

0.14 

(0.0041) 

(0.0042) 

(0.0130) 

(0.0062) 

(0.0065) 

(0.0270) 

PRWORA 

0.059 

0.059 

0.028 

0.12 

0.13 

0.077 

(0.0045) 

(0.0046) 

(0.0140) 

(0.0062) 

(0.0051) 

(0.0220) 

GRADE 

0.53 

0.56 

0.35 

0.35 

0.37 

0.105 

(0.0046) 

(0.0048) 

(0.0150) 

(0.0062) 

(0.0065) 

(0.0250) 

PERSONS  PER  FAMILY 

0.011 

0.0092 

0.0077 

0.029 

0.029 

0.059 

(0.0030) 

(0.0031) 

(0.0100) 

(0.0091) 

(0.0096) 

(0.0380) 

PERCENT  BLACK 

-0.00088 

-0.0009 

-0.0011 

-0.000604 

-0.00061 

-0.00103 

en  nnnri4i 

fd  nnnrvn 

\y.  uuu  1 1 J 

\y.  uuu  11^ 

en  nnm  n 

PERCENT  FOREIGN  BORN 

-0.00014 

-0.00011 

-0.0015 

-0.00104 

-0.0011 

-0.000601 

(0.00004) 

(0.00004) 

(0.00013) 

(0.00012) 

(0  00013) 

(0.00051) 

PERCENT  BACHELORS 

0.0027 

0.0028 

0.0011 

0.000023 

0.00013 

(0.00007) 

(0.00007) 

(0.00024) 

(0.00024) 

(0.00100) 

PERCENT  FEMALES  IN 

-0.00023 

-0.00024 

-0.00071 

-0.00058 

-0.0018 

LABOR  FORCE 

(0.00007) 

(0.00008) 

(0.00023) 

(0.00024) 

(0.00097) 

Adjusted  R2 

0.23 

0.25 

0.14 

0.49 

0.48 

0.49 

Standard  errors  are  in  parenthesis. 
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Table  4-11.  Reduced  form  regressions  using  census  data  for  passing  reading  and  SAT-9 


jjcpcnaont  vdndrjie 

PASS 

PASS 

PASS 

PASS 

PASS 

PASS 

ISJl.rt_lJ.Ll.NkJ 

■RPATYTNTfi 

r.  m  i  ;  1 1  ^ 

RPAT5TNG 

 — :  

Specification 

1 
1 

c 

-2 

A 

J 

f. 

Group 

A  11 

All 

VT    *.     1         'C  J 

Not  classified 

Classined 

A  11 
AH 

XT**. 

Mot 

das  sine  d 

classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Student 

Student 

Student 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

ELIGIBLE*PRWORA* 

0.069 

0  07 

0.047 

0.104 

0.12 

-0.088 

GRADE 

(0.0071) 

(0.0074) 

(0.0220) 

(0.0890) 

(0.0093) 

(0.0340) 

Adjusted  R 

0.23 

0.25 

0.14 

0.49 

0.48 

049 

Dependant  variable 

PASS 

PASS 

PASS 

PASS 

PASS 

PASS 

CAT  Q 
jAl -y 

<?  AT  Q 
iAl  -y 

CAT  Q 

oAl -y 

c  AT  0 
oAl -y 

CAT  Q 

CAT  0 

Specification 

i 
1 

e 

■2 
J 

A 
M 

J 

£ 
0 

Group 

A 11 

AH 

XT  —  *.  _.1___J-__  J 

Not  classified 

Classined 

A  11 

All 

XT-*. 

Not 

Classified 

1         'C  J 

classified 

"PivpH  "Rffprts 

A.  lAlrW    1  .111.1  .L^ 

Grade 

Grade 

Grade 

Studpnt 

Stiirfpnt 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

ELIGBLE*PRWORA* 

0.078 

0.081 

0.041 

0.104 

0.12 

-0.088 

GRADE 

(0.0067) 

(0.0070) 

(0.0098) 

(0.0890) 

(0.0093) 

(0.0340) 

Adjusted  R2 

0.25 

0.27 

0.15 

0.49 

0.48 

049 

Standard  errors  are  in  parenthesis. 
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Table  4-12.  Probit  regressions  for  passing  math 

Dependant  variable 

PASS 

PASS 

PASS 

MATH 

MATH 

MATH 

op  e  cine  anon 

1 

2 

3 

Group 

All 
Ail 

Not 

Classified 

classified 

rixeo  littects 

kirade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

e  s  uiriaie 

estimate 

estimate 

FT  TGTBT  E*PRWORA  *GRADE 

0.029 

0.031 

-0.0071 

(0.0102) 

(0.0104) 

(0.0380) 

ELIGIBLE*PRWORA 

0.013 

0.013 

0.041 

(0.0089) 

(0.0360) 

T7T  TiTD  T  ~C  *i^"D  A  TlU 
Kl  .1  111  HI  .K*tiKAIJn 

n  10Q 

-u.  iKjy 

-0.11 

-0.084 

(0.0086) 

(0.0089) 

(0.0086) 

PRWORA*GRADE 

-0.063 

-0.063 

-0.045 

(0.0073) 

(0.0076) 

(0.0270) 

ELIGIBLE 

-0.17 

-0.16 

-0.14 

(0.0075) 

(0.0077) 

(0.0340) 

PRWORA 

0.08 

0.081 

0.041 

(0.0061) 

(0.0063) 

(0.0230) 

GRADE 

0.49 

0.52 

0.24 

(0.0041) 

(0.0042) 

(0.0041) 

PERSONS  PER  FAMILY 

0.013 

0.012 

0.0031 

(0.0037) 

(0.0051) 

(0.0100) 

PERCENT  BLACK 

-0.0011 

-0.0011 

-0.0012 

(0.00005) 

(0.00005) 

(0.00013) 

PERCENT  FOREIGN  BORN 

-0.00013 

-0.000104 

-0.0015 

(0.00008) 

(0.00005) 

(0.00014) 

PERCENT  BACHELORS 

0.0032 

0.0036 

0.00107 

(0.00009) 

(0.00010) 

(0.00022) 

PERCENT  FEMALES  TN 

-0.00025 

-0.00027 

— 

LABOR  FORCE 

(0.0091) 

(0.0010) 

Adjusted  R 

0.19 

0.2 

0.13 

Standard  errors  are  in  parenthesis 
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Table  4-13.  Probit  regressions  for  passing  reading  and  SAT-9 


Dependant  variable 

PASS 

PASS 

PASS 

READING 

READING 

READING 

Specification 

1 

2 

3 

All 

Not 

Classified 

classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Vanable 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

ELIGTBLETRWORA 

0.043 

0.042 

0.028 

*GRADE 

(0.0095) 

(0.0098) 

(0.0350) 

Adjusted  R 

0.18 

0.2 

0.13 

Dependant  variable 

PASS 

PASS 

PASS 

SAT-9 

SAT-9 

SAT-9 

Specification 

1 

2 

3 

Group 

All 

Not 

Classified 

classified 

Fixed  Effects 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

ELIGIBLE*PRWORA 

0.039 

0.04 

0.011 

*GRADE 

(0.0100) 

(0.0104) 

(0.0370) 

Adjusted  R 

0.2 

0.22 

0.15 

Standard  errors  are  in  parenthesis. 
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Table  4-14.  Comparison  group  regressions  for  math 


jjcpcnoani 

MATH 

MATH 

MATH 

MATH 

MATH 

MATH 

v  cu  lauiL 

Soecification 

1 

2 

3 

4 

5 

6 

Group 

All 

All 

Not 

F.liPible 

All 

Not 

Eligible 

pli  pihle 

eligible 

rixed  unecLS 

("Traf"lp 

Grade 

School 

School 

School 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

OUT-IN 

-29.43 

-30.29 

-28.83 

-29.45 

-30.62 

-28.17 

(0.630) 

(1.400) 

(0.690) 

(0.690) 

(1.360) 

(0.801) 

IN-IN 

-15.64 

-17.65 

-14.5 

-15.73 

-17.43 

-14.63 

(0.65) 

(114) 

(0.78) 

(0.67) 

(1.11) 

(0.82) 

M-OUTearly 

0.14 

0.23 

0.078 

0.15 

0.23 

0.096 

(0.17) 

(0.27) 

(0.22) 

(0.17) 

(0.26) 

(0.22) 

TN-OTJTlate 

7.73 

6.95 

8.37 

7.76 

6.64 

8.57 

(0.16) 

(0.26) 

(0.20) 

(0.15) 

(0.25) 

(0.20) 

ELIGIBLE 

-24.76 

-18.04 

(0.14) 

(0.16) 

BLACK 

-18.26 

-23.46 

-16.42 

-15.94 

-18 

-12.96 

(0.15) 

(0.28) 

(0.17) 

(0.19) 

(0.34) 

(0.23) 

Adjusted  R 

0.36 

0.29 

0.29 

0.38 

0.34 

0.32 

Standard  errors  are  in  parenthesis. 
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Table  4-15.  Comparison  group  regressions  for  reading 


Dependant 

READING 

READING 

READING 

READING 

READING 

READING 

variable 

Specification 

1 

2 

3 

4 

5 

6 

Group 

All 

Not 

Eligible 

All 

Not 

Eligible 

eligible 

eligible 

Fixed  Effects 

Grade 

Grade 

Grade 

School 

School 

School 

Grade 

Grade 

Grade 

v  anable 

Uoemcient 

^oemcieni 

\_,  o  emcicnt 

\    r\  pffl  n  Pfit" 
'w  K)  CiiiLlCIlL. 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

OUT-IN 

-24.29 

-27.84 

-23.23 

-25.05 

-28.94 

-23.31 

(0.480) 

(1.150) 

(0.505) 

(0.602) 

(1.240) 

(0.670) 

IN-IN 

-14.06 

-17.75 

-11.99 

-14.46 

-17.72 

-12.22 

(0.49) 

(0.93) 

(0.55) 

(0.58) 

(1.01) 

(0.69) 

IN-OUTearly 

-0.087 

0.33 

-0.37 

-0.103 

0.29 

-0.37 

(0.15) 

(0.26) 

(0.19) 

(0.15) 

(0.24) 

(0.18) 

TN-OUTlate 

7.35 

6.47 

7.96 

7.12 

5.99 

7.88 

(0.13) 

(0.22) 

(0.16) 

(0.14) 

(0.23) 

(0.16) 

ELIGIBLE 

-24.91 

-18.02 

(0.12) 

(0.14) 

BLACK 

-14.77 

-19.15 

-13.15 

-11.99 

-13.57 

-9.26 

(0.120) 

(0.260) 

(0.140) 

(0  170) 

(0.310) 

(0.201) 

Adjusted  R 

0.37 

0.25 

0.33 

0.39 

0.3 

0.36 

Standard  errors  are  in  parenthesis. 


132 


Table  4-16.  Comparison  group  regressions  for  SAT-9 


Dependant 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

SAT-9 

variable 

Specification 

1 

2 

3 

4 

5 

6 

Group 

All 

Not 
eligible 

Eligible 

All 

Not 
eligible 

Eligible 

Fixed  Effects 

Grade 

Grade 

Grade 

School 
Grade 

School 
Grade 

School 
Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Coefficient 

Loemcient 

estimate 

estimate 

estimate 

estimate 

estimate 

estimate 

OUT-IN 

-53.72 

-58.13 

-52.07 

-54.5 

-59.55 

-51.48 

(1.02) 

(2.38) 

(1.09) 

(1.20) 

(2.41) 

(1.36) 

IN-IN 

-29.7 

-35.39 

-26.49 

-30.19 

-35.16 

-26.59 

(1.06) 

(1.93) 

(1.23) 

(1.15) 

(1.97) 

(1.41) 

IN-OUTearly 

0.056 

0.55 

-0.29 

0.06 

0.53 

-0.27 

(0.302) 

(0.490) 

(0.380) 

(0.290) 

(0.470) 

(0.370) 

T\T    /\T  I'll  i_ 

IN-OUTlate 

15.0a 

13.42 

1  C  11 

10 .55 

14. Uo 

12.04 

1 0.4  J 

(0.27) 

(0.44) 

(0.34) 

(0.27) 

(0.45) 

(0.34) 

ELIGIBLE 

-49.68 
(0.25) 

-36.07 
(0.28) 

BLACK 

-33.02 

-42.62 

-29.57 

-27.94 

-31.58 

-22.23 

(0.25) 

(0.51) 

(0.29) 

(0.34) 

(0.61) 

(0.41) 

Adjusted  R2 

0.4 

0.31 

0.35 

0.42 

0.35 

0.37 

Standard  errors 

are  in  parenthesis. 
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Table  4-17.  Comparison  group  regressions  using  census  data  for  math 


Dependant  variable 

MATH 

MATH 

MATH 

Specification 

1 

2 

5 

Group 

All 

Not  eligible 

Eligible 

Fixed  Effects 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

OUT-IN 

-33.45 

-31.9 

-29.07 

(0.74) 

(1.56) 

(0.79) 

IN-IN 

-18.3 

-17.87 

-16.02 

(0.79) 

(1.32) 

(0.91) 

IN-OUTearly 

-0.22 

-0.041 

-0.17 

(0.20) 

(0.31) 

(0.26) 

TN-OUTlate 

6.98 

6.89 

8.97 

(0.19) 

(0.29) 

(0.24) 

PERSONS  PER  FAMILY 

1.6 

2.52 

-0.47 

(0.34) 

(0.49) 

(0.43) 

PERCENT  BLACK 

-0.2 

-0.099 

-0.102 

(0.0042) 

(0.0078) 

(0.0051) 

PERCENT  FOREIGN  BORN 

-0.071 

-0.085 

0.094 

(0.0047) 

(0.0075) 

(0.0059) 

PERCENT  BACHELORS 

0.65 

0.53 

0.24 

(0.0082) 

(0.0120) 

(0.0120) 

PERCENT  FEMALES  IN 

0.045 

-0.087 

0.016 

LABOR FORCE 

(0.0083) 

(0.0130) 

(0.0100) 

Adjusted  R 

0  33 

0.31 

0.29 

Standard  errors  are  in  parenthesis. 
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Table  4-18.  Comparison  group  regressions  using  census  data  for  reading 


Dependant  variable 

READING 

READING 

READING 

Specification 

1 

2 

3 

Group 

All 

Not  eligible 

Eligible 

Fixed  Effects 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

OUT-IN 

-27.7 

-28.86 

-23.12 

(0.56) 

(1.26) 

(0.58) 

IN-IN 

-16.51 

-18.13 

-13.22 

(0.60) 

(1.07) 

(0.65) 

IN-OUTearly 

-0.35 

0.15 

-0.54 

(0.18) 

(0.28) 

(0.22) 

IN-OUnate 

6.68 

6.35 

8.62 

(0.16) 

(0.25) 

(0.19) 

PERSONS  PER  FAMILY 

-0.054 

0.8 

-1.86 

(0.30) 

(0.45) 

(0.37) 

PERCENT  BLACK 

-0.16 

-0.074 

-0.068 

(0.004) 

(0.007) 

(0.004) 

-U  U4j 

-U.U  /j 

U.  lUo 

BORN 

(0.0040) 

(0.0066) 

(0.0050) 

PERCENT  BACHELORS 

0.71 

0.56 

0.35 

(0.0073) 

(0.0098) 

(0.0110) 

PERCENT  FEMALES  IN 

0.104 

-0.031 

0.076 

LABOR FORCE 

(0.0073) 

(0.0120) 

(0.0089) 

Adjusted  R2 

0.35 

0.28 

0.34 

Standard  errors  are  in  parenthesis 
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Table  4-19.  Comparison  group  regressions  using  census  data  for  SAT-9 


Dependant  variable 

SAT-9 

SAT-9 

SAT-9 

Specification 

i 
i 

3 

Group 

A  11 

AH 

JN  ot  eligible 

Fixed  Effects 

Grade 

Grade 

Grade 

Variable 

Coefficient 

Coefficient 

Coefficient 

estimate 

estimate 

estimate 

OUT-IN 

-61.16 

-60.76 

-52.18 

(1.20) 

(2.63) 

(1.25) 

IN-IN 

-34.3 

-36.07 

-29.24 

(1.30) 

(2.24) 

(1.45) 

IN-OUTearly 

-0.58 

0.109 

-0.71 

(0.36) 

(0.55) 

(0.45) 

IN-OUTlate 

13.66 

13.23 

17.59 

(0.32) 

(u.^yj 

(Q.JS) 

PERSONS  PER  FAMlLi 

1.  j4 

-Z.5y 

fti 

[y.av) 

[V.  /  J) 

PERCEM I  BLACK 

-U.  j  / 

n  n 
-U.  1  / 

n  n 
-U.  1  / 

(0.0072) 

(0.0013) 

(0.0087) 

-0  1? 

~\J.  1  c. 

-0  16 

0  2 

BORN 

(0.0082) 

(0.0130) 

(0.0102) 

PERCENT  BACHELORS 

1.36 

1.09 

0.59 

(0.014) 

(0.019) 

(0.021) 

PERCENT  FEMALES  IN 

0.15 

-0.12 

0.091 

LABOR FORCE 

(0.0015) 

(0.0230) 

(0.0180) 

Adjusted  R 

0.37 

0.32 

0.35 

Standard  errors  are  in  parenthesis. 


CHAPTER  5 
CONCLUSION 

Policymakers  in  the  United  States  routinely  pass  legislation  that  they  feel  will  be 
beneficial  to  Americans.  The  welfare  reform  bill  of  1996  is  a  prime  example  of  this 
occurrence.  Supported  by  both  Republicans  and  Democrats,  the  purposes  of  PRWORA 
were  to  move  welfare  recipients  to  the  workplace  and  to  promote  stable  families.  Past 
economic  research  has  focused  on  the  effects  of  welfare  reform  adult  behaviors,  but 
limited,  if  any,  research  has  focused  on  the  effects  that  PRWORA  had  on  children.  This 
dissertation  is  the  first  study  to  examine  what  the  effects  of  welfare  reform  were  on 
disabled  children  and  to  determine  if  those  effects  were  helpful  or  hurtful. 

Chapters  2  and  3  focused  on  what  the  exact  effect  of  welfare  reform  was  on  the 
classification  rates  of  disabled  children.  Results  showed  that  following  PRWORA, 
classification  rates  fell  by  a  statistically  significant  magnitude.  Furthermore,  as 
demonstrated  in  chapter  4,  that  standardized  test  scores  significantly  increased  following 
the  policy.  Both  math  and  reading  scores  improved  among  children  that  were  removed 
from  a  special  education  setting  following  the  policy  change.  This  suggests  that  some 
misclassification  was  occurring  prior  to  the  legislation  and  that  PRWORA  eliminated 
some  of  the  perverse  incentives. 

Unfortunately,  the  evaluation  of  welfare  reform  cannot  cease  at  this  point.  Further 
evaluations  are  needed  that  focus  on  the  other  federal  programs  that  were  changed  as  a 
result  of  PRWORA.  For  example,  no  economic  studies  exist  that  investigate  the  changes 
in  the  Food  Stamp  or  the  Medicare  programs  and  their  subsequent  affects  on  children's 
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health  indicators.  Why  does  policy  analysis  need  to  be  done  in  this  area?  Simply  put, 
poverty  is  cyclical  across  generations.  Efforts  by  the  government  to  change  the  behaviors 
of  the  current  generation  will  be  muted  if  the  next  generation  reverts  back  to  the  same 
behaviors.  Fortunately,  this  will  most  likely  not  happen  if  the  children  of  welfare  reform 
recipients  are  made  better  off  by  PRWORA.  If  welfare  reform  is  able  to  meet  it's 
objectives  while  increasing  children's  educational,  health  and  crime  outcomes,  then 
society  is  better  off.  Economists,  and  other  researchers,  can  begin  to  get  an  idea  of  what 
PRWORA  has  done  to  children's  outcomes  by  continuing  to  do  sound  research. 

Extensions  of  this  dissertation  that  evaluate  welfare  reform  should  focus  on  three 
areas:  children's  health,  education  and  crime  outcomes.  To  fully  grasp  the  impact  of 
PRWORA,  each  area  needs  to  be  further  researched.  Children's  outcomes  were  affected 
by  numerous  changes  in  existing  programs.  Since  data  for  low  income  children  are 
readily  available  from  a  variety  of  sources,  I  intend  to  extend  this  line  of  research.  For 
example,  one  research  question  I  have  is  whether  the  promotion  of  stable  families  is  good 
for  children.  Meaning,  if  the  government,  as  seen  in  one  of  PRWORA's  objectives, 
wants  to  increase  marriage  rates,  what  effect  will  this  have  on  children's  outcomes?  If 
single  mothers  chose  to  be  married  or  stay  in  a  marriage  due  to  government  created 
financial  incentives,  is  this  better  or  worse  for  the  child?  Considering  the  fact  that  many 
low  income  women  suffer  from  domestic  abuse,  will  these  policy  changes  encourage 
women  to  stay  in  abusive  marriages?  These  and  other  questions  are  important  to  consider 
for  the  sake  of  low  income  children  across  America. 

Reauthorization  of  PRWORA  began  in  September  2002.  Policymakers  were 
instructed  to  revise  and  recommit  to  the  original  objectives  based  on  the  performance  of 
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PRWORA  over  the  past  six  years.  Although  the  reauthorization  process  is  not  complete, 
policymakers  and  researchers  still  have  an  obligation  not  only  to  pass  legislation,  but  also 
to  evaluate  its  effects  on  Americans  after  the  fact.  The  original  bill  and  its 
reauthorization  both  demand  that  researchers  continue  to  investigate.  This  system  of 
checks  and  balances  can  only  benefit  Americans  as  we  learn  from  both  our  successes  and 
failures. 


APPENDIX  A 
DESCRIPTION  OF  VARIABLES 

APGAR- 1  MINUTE=  apgar  score  one  minute  after  birth. 

APGAR-  5  MINUTES=  apgar  score  five  minutes  after  birth. 

BLACK=  this  dummy  variable  equals  1  if  a  child  is  black  and  0  otherwise. 

BIRTH  WEIGHT=  birth  weight  in  pounds. 

CLASSIFIED=  dummy  variable  equal  to  1  if  the  child  has  a  primary  exceptionality 
other  than  gifted. 

CLASSIFIED  RESIDUAL=  predicted  residual  found  by  partialling  out  individual  birth 
vital  statistics. 

COHORT  1=  this  dummy  variable  is  equal  to  1  for  children  who  are  in  the  oldest  cohort. 

These  children  started  school  in  the  1992-1993  school  year. 

COHORT  2=  this  dummy  variable  is  equal  to  1  for  children  who  are  in  the  middle 

cohort.  These  children  started  school  in  the  1993-1994  school  year. 

COHORT  3=  this  dummy  variable  is  equal  to  1  for  children  who  are  in  the  youngest 

cohort.  These  children  started  school  in  the  1994-1995  school  year. 

COHORT=  dummy  variable  equal  to  1  if  child  is  in  the  youngest  cohort,  and  equal  to  0 

otherwise. 

ELIGIBLE=  this  independent  variable  is  a  dummy  variable  equal  to  1  for  children  that 
are  free/reduced  lunch  eligible. 

GRADE=  this  dummy  variable  equals  1  for  a  child  in  grades  3  or  4. 
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HIGH  COST  DISABILITY=  dummy  variable  equal  to  1  when  then  corresponding 
disability  category  is  among  the  most  costly. 

IN-IN=  dummy  variable  equal  to  1  when  a  student  was  enrolled  in  special  education 
before  and  after  PRWORA. 

IN-OUT=  dummy  variable  equal  to  1  when  a  student  was  enrolled  in  special  education 
before  PRWORA  and  subsequently  not  classified. 

IN-OUTearly=  dummy  variable  equal  to  1  for  the  years  before  PRWORA  for  a  student 
in  the  IN-OUT  group. 

IN-OUTlate=  dummy  variable  equal  to  1  for  the  years  after  PRWORA  for  a  student  in 
the  IN-OUT  group. 

KG=  dummy  variable  equal  to  1  if  a  child  is  in  kindergarten. 

LOW  COST  DISABILITY=  dummy  variable  equal  to  1  when  then  corresponding 

disability  category  is  among  the  least  costly. 

MATH=  this  is  the  student's  score  on  the  math  section  of  the  SAT-9. 

MOM  AGE=  indicates  mother's  age  at  birth. 

MOM  AGE2=  the  squared  value  of  mother's  age. 

MOM  EDUCATION-  HS+=  dummy  variable  equal  to  0  if  mother  has  less  than  high 
school  education. 

OLD  MOM=  indicates  mothers  whose  age  is  35  or  older. 

OUT-IN=  dummy  variable  equal  to  1  when  a  student  was  not  enrolled  in  special 

education  before  and  was  enrolled  after  PRWORA. 

OUT-OUT=  dummy  variable  equal  to  1  when  a  student  was  not  enrolled  in  special 
education  both  before  and  after  PRWORA. 
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PARENT=  this  is  a  vector  of  variables  that  controls  for  parental  inputs. 

PASS  MATH=  this  is  a  dummy  variable  that  equals  1  when  a  student  passes  the  math 

section  of  the  SAT-9. 

PASS  READING=  this  is  a  dummy  variable  that  equals  1  when  a  student  passes  the 
reading  section  of  the  SAT-9. 

PASS  SAT-9=  this  is  a  dummy  variable  that  equals  1  when  a  student  passes  the  SAT-9. 
PERCENT  BACHELORS=  the  percent  in  a  census  tract  with  a  bachelors  degree. 
PERCENT  BLACK=  the  percent  in  a  census  tract  that  is  black. 
PERCENT  FEMALES  IN  LABOR  FORCE=  the  percent  of  females  in  a  census  tract 
that  participate  in  the  labor  force. 

PERCENT  FOREIGN  BORN=  the  percent  in  a  census  tract  that  is  foreign  born. 
PERSONS  PER  FAMILY=  the  average  number  of  persons  per  family  in  a  census  tract. 
PRENATAL  CARE=  dummy  variable  equal  to  1  if  mother  had  prenatal  care. 
PRWORA=  dummy  used  to  indicate  the  year  1996  or  greater,  corresponds  to  the  year 
that  the  PRWORA  policy  went  into  affect. 

READING=  this  is  a  student's  score  on  the  reading  section  of  the  SAT-9. 

SAT-9=  this  is  a  student's  score  on  the  SAT-9. 

SCHOOL=  this  is  a  vector  of  variables  that  controls  for  school  inputs. 

SECOND=  dummy  variable  equal  to  1  if  a  child  is  in  second  grade. 

STUDENT=  this  is  a  vector  of  variables  that  controls  for  student  inputs. 

SWITCH=  dummy  used  to  indicate  that  a  student  changed  districts  from  one  year  to  the 

next. 
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TRANS=  dummy  used  to  indicate  children  that  gained  classification  from  one  year  to  the 
next. 

WHITE=  dummy  variable  equal  to  1  if  a  child  is  white,  and  equal  to  0  for  non-white. 
YOUNG  MOM=  indicates  mothers  whose  age  is  18  years  or  less. 


APPENDIX  B 
CATEGORIES  OF  EXCEPTIONALITIES 

Primary  exceptionalities  are  categorized  as  follows: 


A 

Educable  mentally  handicapped 

B 

Trainable  mentally  handicapped 

C 

Orthopedically  impaired 

F 

Speech  impaired 

G 

Language  impaired 

H 

Deaf 

I 

Visually  impaired 

T 

J 

Fmntinnallv  handicanned 

K 

Specific  learning  disabled 

M 

Hospital/Homebound 

N 

Profoundly  mentally  handicapped 

0 

Dual-sensory  impaired 

P 

Autistic 

Q 

Severely  emotionally  disturbed 

s 

Traumatic  brain  injury 
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